Methods and apparatus for healthcare facility optimization

ABSTRACT

Methods and apparatus for improving the provision of healthcare via automated determination of a location of persons and equipment relative to each other and to conditions quantified via automated sensors. The present invention provides apparatus and methods for wireless designation of a position of health care providers and equipment relative to each other based upon wireless communications amongst multiple wireless transceivers combined with ongoing monitoring of conditions present in a healthcare facility. A user interface may provide a pictorial view of positions of all or some the healthcare providers and equipment and condition quantifying sensors.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation in part application to the NonProvisional patent application Ser. No. 16/775,223, filed Jan. 28, 2020and entitled SPATIAL SELF-VERIFYING ARRAY OF NODES, which claimspriority to the Non Provisional patent application Ser. No. 16/528,104,filed Jul. 31, 2019 and entitled SMART CONSTRUCTION WITH AUTOMATEDDETECTION OF ADVERSE STRUCTURE CONDITIONS AND REMEDIATION as acontinuation in part; and to the Non-Provisional U.S. patent applicationSer. No. 16/504,919, filed Jul. 8, 2019 and entitled METHOD ANDAPPARATUS FOR POSITION BASED QUERY WITH AUGMENTED REALITY HEADGEAR as acontinuation in part application, which in turn claims priority toProvisional Patent Application Ser. No. 62/793,714, filed Jan. 17, 2019and entitled METHOD AND APPARATUS FOR ORIENTEERING WITH AUGMENTEDREALITY HEADGEAR; and as a continuation in part application to theNon-Provisional U.S. patent application Ser. No. 16/657,660, filed Oct.18, 2019 and entitled METHOD AND APPARATUS FOR CONSTRUCTION ANDOPERATION OF CONNECTED INFRASTRUCTURE; and as a continuation in partapplication to the Non-Provisional U.S. patent application Ser. No.16/688,775, filed Nov. 19, 2019 and entitled METHOD AND APPARATUS FORWIRELESS DETERMINATION OF POSITION AND ORIENTATION OF A SMART DEVICE;and as a continuation in part application to the Non-Provisional U.S.patent application Ser. No. 16/721,906, filed Dec. 19, 2019 and entitledMETHOD AND APPARATUS FOR WIRELESS DETERMINATION OF POSITION ANDORIENTATION OF A SMART DEVICE. The contents of each of the heretoforeclaimed matters are relied upon and incorporated herein by reference.

The present application also references the following relatedapplications whose content are relied upon and incorporated herein byreference; the Non Provisional patent application Ser. No. 16/549,503,filed Aug. 23, 2019 and entitled METHOD AND APPARATUS FOR AUGMENTEDVIRTUAL MODELS AND ORIENTEERING; and the Non Provisional patentapplication Ser. No. 15/703,310, filed Sep. 13, 2017 and entitledBUILDING MODEL WITH VIRTUAL CAPTURE OF AS BUILT FEATURES AND OBJECTIVEPERFORMANCE TRACKING; and the Non Provisional patent application Ser.No. 16/161,823, filed Oct. 16, 2018 and entitled BUILDING MODEL WITHCAPTURE OF AS BUILT FEATURES AND EXPERIENTIAL DATA; and the NonProvisional patent application Ser. No. 15/887,637, filed Feb. 2, 2018and entitled BUILDING MODEL WITH CAPTURE OF AS BUILT FEATURES ANDEXPERIENTIAL DATA; and the Non Provisional patent application Ser. No.16/165,517, filed Oct. 19, 2018 and entitled BUILDING VITAL CONDITIONSMONITORING, FIELD OF THE INVENTION

The present invention relates to methods and apparatus for improving theprovision of healthcare via automated determination of a location ofpersons and equipment relative to each other and to conditionsquantified via automated sensors. More specifically, the presentinvention provides apparatus and methods for wireless designation of aposition of persons and equipment relative to each other based uponwireless communications amongst multiple wireless transceivers combinedwith ongoing monitoring of conditions present in a healthcare facility.

BACKGROUND OF THE INVENTION

The provision of healthcare has improved significantly as science andtechnology advance new treatment protocols. The historical doctor's baghas been replaced by sophisticated processor controlled equipment andhealthcare procedures. Once a single doctor, perhaps assisted by anurse, would be responsible for diagnosis, designation of a treatmentprotocol, and performance of a treatment action. Now health careprofessionals tend to specialize in a specialty area and only perform asmall number of procedures. As a result, teams of doctors, nurses,technicians, physician's assistant, nurse practitioners, transportpersonnel, and others are now involved in single treatment protocol.

One consequence of such team oriented health care is a need tocoordinate team members to act in an efficient manner. However,hospitals and other treatment centers lack systems and equipment toimplement efficient coordination or any system to track variables inteam coordination in order to bring about a most beneficial outcome of atreatment protocol.

In addition, while other major endeavors in the information age havemade use of the power of large scale processors in order to bring aboutincreased efficiencies and effectiveness, health care has lagged behindin its ability to gather meaningful data useful in the optimization ofthe provision of healthcare. While some efforts are being made to applyartificial intelligence (AI) to areas such as disease state diagnosis ormedical research, little or nothing has been done to apply AI to theprovision of healthcare, in part because very little date exists towhich AI techniques may be applied.

Meanwhile, wireless determination of a position has been known for manyyears. Various techniques and corresponding wavelengths have theirstrengths and drawbacks. One significant drawback has been thespecialized equipment and training required to utilize wireless positiondetermination equipment. For example, use of systems such as radarrequire specialized equipment and training.

In contrast, most people have access to a smart device. Theproliferation of global positioning system (GPS) capabilities by smartdevices has alleviated the need for such specialized equipment andtraining by incorporating the specialized circuitry into the smartdevice, and proliferating apps that operate the GPS circuitry. Smartdevices are used almost ubiquitously by people in first-world populationcenters. Smart phones and tablets are often within reach of peoplecapable of operating them and are relied upon for almost any purpose forwhich an app may be written.

However, known geolocation technologies (as may be deployed with modernSmart Devices) also have drawbacks. GPS is purposefully limited in itsaccuracy by the government. Other technologies and correspondingstandards (which operate at different wavelength bands), such asBluetooth, ANT, near field communications, internal compasses and WiFi,are easily obstructed and have very limited range. Also, suchtechnologies are often only operative to indicate where a particularsmart device is located and lack any capability to indicate anorientation.

SUMMARY OF THE INVENTION

Accordingly, the present invention provides for methods and apparatus tomanage health care provision via wireless tracking of persons;equipment; and/or resources including a position and orientation of thepersons, equipment and or resources. Persons may include, by way ofnonlimiting example, one or more of: a patient, health care providers(physicians, physician assistants, nurse practitioners, nurses,technicians, phlebotomists, etc.); and other hospital staff (such as,for example: transport staff, technicians, therapists, administrativepersonnel, and food services staff), sometimes referred to hereincollectively as Healthcare Providers (“HCP”s). Equipment may include anyfixed position, portable or transportable, machine or electronic device.A resource may include a physical area, such as an examination room,operating room, recovery room, patient room, waiting room or otherdefined area of a health care facility.

The present invention provides for a tracking of position and one orboth of a direction of interest and an orientation of a smart device,based upon wireless communications between a transceiver designating areference point and one or both of: a physical wireless tag; and avirtual tag generated by a smart device.

The healthcare optimization system of the present invention enablesdynamic coordination of professionals; equipment and resources basedupon wireless determination of position and orientation. Theoptimization system may be operated to deploy specific health careproviders; equipment and resources in a scheduled manner depending uponthe needs of a patient undergoing a procedure. The deployment of thehealth care providers; equipment and resources may be in sequence andaccording to a schedule of healthcare procedure actions to be performed.Tracking of which healthcare procedure actions have been performed andwhich still remain to be executed may be determined according to one ormore of: a list of actions included in a procedure; a sequence of theactions listed; a relative position and orientation of health careproviders; equipment and resources; user inputs into a user interactivedevice (or screen); and patient biometric data measured during theprocedure.

In some embodiments, a user may monitor ongoing data provided by thehealthcare optimization system of the present invention and interactwith a user interface to implement actions included in a list ofhealthcare procedure actions, or to generate new actions based upon datagenerated during the healthcare procedure. For example, a user maymonitor a healthcare procedure and determine that an additional item ofequipment needs to be brought to the location of the patient andgenerate a new action in the healthcare optimization system to have theneeded equipment brought to the patient location. In another example, auser may monitor the ongoing data and determine that the patient will beready to be transported within the next several minutes and locate anappropriate transporter in proximity to the patient. A communication maybe generated and sent to the transporter to proceed to the patient'slocation in order to timely transport the patient. If the patient hadoccupied a resource, such as an operating room, the system may alsoregister when the patient has been transported out of the resource, andgenerate a new action item to prepare the resource for a next procedure.Additional actions and status qualifiers may be generated and be based,at least in part upon a location and direction of one or more of: healthcare providers; equipment and resources.

In another aspect of the present invention, conditions, actions,locations, orientations, are quantified and subjected to unstructuredqueries and/or artificial intelligence (sometimes referred to herein as“AI”) procedures to generate process improvements. Although applicationof AI has begun to be explored, the application of AI is generallylimited to research and/or diagnosis of a patient condition. The presentinvention provides for electronic and electromechanical transducers toquantify one or more of: an ambient condition, a location, anorientation and an Agent action, as digital values. The presentinvention enables the quantified digital values to be submitted to AIroutines and/or unstructured queries in order to determine which sets ofvariables (representative of the quantified ambient conditions, alocations, orientations and Agent actions) lead to which results.

For example, the present invention provides for nonintrusive generationof data to be referenced in AI processes and/or unstructured queries.The nonintrusive gathering of data is accomplished via automatedquantification of values for variables relating to one or more of:resources used for a procedure; a temperature and humidity of a resourceambient condition; presence of an audio frequency and/or pattern;lighting conditions; airflow; duration of a procedure; who was presentin proximity to the procedure, including when and where each person waspresent; an orientation of each person during a procedure (and arelative position to each other and the patient); a sequence of actionstaken during the procedure and positions of each person during eachaction; medical supplies used during a procedure; medical devicesimparted to a patient during a procedure; which equipment was presentduring a procedure; an orientation of an item of equipment;operation/activation of an item of equipment; and almost any othercondition, position, orientation or action that is quantifiableaccording to the methods and apparatus presented herein.

According to the present invention the quantification of the variablesrelated to a healthcare related procedure may be accomplished withautomated sensors that have an associated position determined based uponwireless transmissions (as discussed herein). Automated sensor devicesmay be fixedly attached to one or more transceivers (such as for examplea transceiver tag); have a transceiver included within the sensor device(internal transceiver tag), or be associated with a virtual taggenerated by a smart device placed in proximity to an item or person tobe tagged.

In some embodiments, a physical tag location and/or a virtual taglocation may be determined via a self-verifying array of Nodes(sometimes referred to herein as “SVAN”). Various Nodes within the SVANverify positions of respective Nodes included in the array the array ofnodes. A position for each Node is generated based upon sets of valuesof variables derived from wireless communications (sometimes referred toherein as “position determination variables”). The positiondetermination variables may include one or more of: a time oftransmission of a data set during wireless communication between Nodes;a time of arrival of a data set during wireless communication betweenNodes; a phase change between disparate antennas receiving a wirelesscommunication; an angle of arrival of a data set; an angle of departureof a data set; a quality of a wireless transmission (e.g., based on apresence of noise in the received transmission); a strength of awireless transmission (e.g., as measured by amplitude of a receivedtransmission); or other factor influencing a wireless data transmission.

According to the present invention, an array of Nodes self-verifiespositions of respective Nodes included in the array by generatingmultiple sets of values for position determination variables for each ofthe Nodes in the array. Each set of values is based upon multipledisparate communications involving respective pairs of a transmittingNode and a receiving Node. In this manner, multiple sets of values forposition determination variables are generated for each respective Nodeduring a given timeframe. Each set of values for position determinationvariables may be used to verify a position of a designated Node bycomparing a position determined via use of a first set of values forvariables to positions determined via use of set(s) of variables otherthan the first set of variables. Each determined position for a givenNode thereby verifies or challenges other determined positions.

Other embodiments may include generation of X,Y coordinates based upontriangulation and wireless communications between a reference pointtransceiver and a smart device.

In some embodiments, outlier sets of position determination variablesmay be excluded. In another aspect, in some embodiments, an algorithmmay be used to generate a composite position for a given Node based uponmultiple sets of position determination variables (for example, bygenerating a weighted average of expected positions based on thedisparate sets of values of position determination variables).

In various embodiments, a determined position of Node may include aposition for a first Node relative to a position of a second Node, orrelative to a base position. Each position is generally represented as aset of coordinates. The coordinates may include, for example, Cartesiancoordinates, cylindrical coordinates and/or Polar coordinates. The Nodesmay include transceivers transmitting and receiving one designatedbandwidth of communication wavelength; or transceivers operatingaccording to disparate wireless protocols and across multiplebandwidths. In some embodiments, a wireless communications Node mayreceive a data set via a first wavelength (and first associatedprotocol) and transmit some or all of the data set via a secondwavelength (and second associated protocol) or combine transceiverscapable of communicating via multiple wavelengths and protocols.

The self-verifying arrays of Nodes of the present invention includecollections of numerous wireless communication Nodes operative tocooperatively enhance communications, location tracking, anddetermination of other useful aspects of an array of Nodes, such asproximity of Nodes to each other and/or an item of interest, distance ofNodes to each other and/or an item of interest, direction of Nodes toeach other and/or an item of interest, and whether or not two Nodes arecapable of direct communication between themselves. Self-verifyingarrays may be deployed to significantly optimize and improve accuracy ofdetermining a location of a Sensor, tracking of items, tracking ofAgents and/or persons in real-world scenarios, such as a HealthcareFacility, and a partially built or completed Healthcare Facility, asnon-limiting examples.

In some exemplary embodiments, a designated location may includestationary wireless Nodes that are fixed to stationary item in orproximate to a Healthcare Facility such as a building part or astanchion secured to a ground point. The site may also include mobilewireless Nodes which may be fixed to items, persons and/or Agentscapable of attaining dynamic locations. Various assets and buildingmaterials may be fitted with wireless Nodes that are combined into aself-verifying array.

In some examples, wireless communications between wireless Nodes may beaccomplished in adherence to a Bluetooth protocol, such as, by ways ofnon-limiting example, Bluetooth 5.1 or Bluetooth Low Energy (BLE 5.1).In other examples, RFID type tags may communicate information inresponse to a stimulus. In some examples, energy to power a Node may beprovided by a wireless transmission to the Node to be powered.

In general, Nodes making up a self-verifying array communicate to otherwireless Nodes. The wireless communications may include one or both ofsensor data and location-identification data. Location-identificationdata may include one or more of: values for variables that are usefulfor determining a position, information useful for determine a polarcoordinate (e.g., angle of arrival; angle of departure; and distance);or information useful for determining a Cartesian Coordinate (e.g.,X,Y,Z coordinates). The location-identification data may be one or bothof: relative to two Nodes or relative to a base position. By way ofnon-limiting example, of location-identification data may include one ormore of: transmitting and receiving timing data; angle of arrival; angleof departure; a calculated distance; and a set of coordinates.

Location-identification data involving a particular Node may begenerated by that Node. For example, a Node X may generatelocation-identification data relative to multiple other Nodes with whichNode X is capable of communicating. Node X may also receive, viawireless communication, location data generated by other Nodes. Node Xmay aggregate both types of location-identification data and transmitthe aggregated data out to any wireless transceiver within range that iscapable of receiving the aggregated data.

A controller, such as a controller in a Smart Device or in a cloudserver, may generate a map indicating locations of various Nodes at aninstance in time. Each location of each Node may be based upon one ormore sets of location-identification information since each Node maycommunicate with multiple other Nodes. Accuracy of a location of aparticular Node may be enhanced by mathematically blending multiple setsof location-identification information for that particular Node, such asan average of reported data (including, in some embodiments, a weightedaverage). In some embodiments, a strength of a wireless communicationmay be determined and recorded and considered in the blending ofmultiple sets of location-identification data.

In some embodiments, a sensor may be co-located with a particular Node,In this manner, data generated by the Sensor during a particular timeperiod may be associated with the position of a co-located Node. In someembodiments, data generated by a Sensor (Sensor Data) may be transmittedbetween Nodes on a periodic basis. Transmission of Sensor Data betweenNodes may be in addition to location-identification information, orindependent of other transmissions, including transmissions oflocation-identification information. Other embodiments includetransmission of Sensor data in response to a command requesting theSensor data.

Accordingly, some embodiments include transmission and receipt of SensorData for the purposes of aggregating and retransmitting the receiveddata. The sensor data may quantify a condition at a location orproximate to a location of a Node in logical communication with theSensor. In another aspect, disparate Nodes may transmit data to otherNodes, wherein the data has been provided by Sensors co-located with orproximate to respective Nodes. Each Node may aggregate data received viacommunications with other Nodes and/or received from Sensors (orassemblies of multiple Sensors) co-located with or proximate torespective Nodes.

Sensor data may thereby be aggregated from disparate Nodes at disparatelocations across a large area occupied by Nodes that interconnect into aself-verifying array. This may be beneficial in embodiments in which thebreadth of a physical area covered by a self-verifying array of Nodesexceeds the point-to-point communication range of one or more of theNodes (e.g., based on the communication modality of the Node).

In addition, a self-verifying array may combine communications usingdisparate bandwidths and protocols to achieve superior performance in avariety of ways, such as improving communications distance, accuracy,and obstacle-penetration efficacy. A self-verifying array may alsoinclude hardwired segments to further achieve improved performance andconnectivity to resources external to the self-verifying array.

By using the self-verifying array of Nodes to effectively expand therange of an individual Node, communication and data retrieval across alarge space is improved. Specifically, establishment of a self-verifyingarray that allows for communication pathways to be established that arelonger than a range of an individual wireless access Node and verifies alocation of a communication commencement and destination, enablessuperior communications across large areas.

For example, a large Healthcare Facility site may include stationaryNodes that form a self-verifying array of Nodes over a large spatialarea included in the site (or even the entire site). A line-of-sightpath between a particular wireless communication base Node and adeployed Node initially interacting with that wireless communicationbase Node may be cut off by various impediments to wirelesstransmission, such as equipment in the Healthcare Facility, materialsstored in the Healthcare Facility, or the Healthcare Facility itself.The self-verifying array may create paths that cooperatively allow thedeployed Node to connect with multiple different wireless communicationNodes included in a self-verifying array to send a communication aroundthe impediment to wireless communication and reach the base Node.

A mobile wireless Node included in the self-verifying array may providedynamic location aspects to the self-verifying array. Devices andmethodology allow for mobile Nodes to supplement stationary Nodes andimprove communications aspects in numerous ways. The mobile Node maytemporarily create a shorter path for communications, which may improveenergy storage aspects of a device interacting with the Node, animproved signal-to-noise aspect, or other advantages.

A communication area covered by an aggregate of wireless Nodes mayextend to a perimeter defined by communication coverage of an aggregateof the Nodes and may encompass communication obstructions within thecommunications area, wherein the obstructions are circumvented bystrategically located Nodes that communicate around the obstruction.

In still further aspects, a self-verifying array of Nodes may allow anAugmented Virtual Model (AVM) of a Healthcare Facility and/or a buildingsite to be updated with the locations of an Agent or equipment that isco-located with a wireless Node. Similarly, materials that areco-located with wireless Nodes may have their location determined and/orconditions experienced by the materials quantified via Sensor readings.This may occur as the materials reside in a storage location and/or asthe materials are used in a Healthcare Facility.

Locations of personnel tagged with a wireless Node may also beidentified for logistics, safety, and other purposes. For example, insome embodiments, a Smart Device may serve as a dynamic Node. The SmartDevice may be supported by an Agent. In such embodiments, locationinformation and other Sensor data from the Smart Device may betransmitted across the self-verifying array. Accordingly, it may bepossible to track the Agent's position, biometrics, and other safetyquantities across the self-verifying array.

A mobile Agent equipped with Node with wireless communicationscapability may also transmit energy beacons into the regions that theAgent moves into. The energy beacons may energize ultralow-energyBluetooth-equipped devices, RFID tags, and the like. Thus, Nodes thathave little or no substantial battery capability may be energized, andmay respond to the energization by transmitting and/or receiving datatransmissions to/from one or both of the mobile Agent and other Nodes.Transmitted data may include an identification of respective Nodes,Sensor-related information, and the like. Other protocols such asstepped power levels in transmission may supplement a location with arelative distance between the tag and the mobile agent being determined.Since the mobile Agent can perform this measurement from numerouspoints, triangulation may be used to improve the accuracy of relativelocation determination of such tags.

DESCRIPTION OF THE DRAWINGS

The accompanying drawings, that are incorporated in and constitute apart of this specification, illustrate several embodiments of theinvention and, together with the description, serve to explain theprinciples of the invention:

FIG. 1A illustrates a block diagram of inter-relating apparatus includedin an automated healthcare facility according to the present invention.

FIG. 1B illustrates a block diagram of automated functions based upondata capture via Smart Devices and Sensors and support for predictivemodeling based upon the smart data capture.

FIG. 1C illustrates geolocation aspects that may be used to identify aHealthcare Facility and corresponding wireless modalities that may beused.

FIG. 1D illustrates an exemplary Healthcare Facility layout with variousitems delineated in a top-down representation, according to someembodiments of the present invention.

FIG. 1E illustrates a diagram of an Agent and Directional Image Data.

FIG. 2 illustrates a block diagram of an Augmented Virtual Modelingsystem.

FIGS. 3A-3D illustrate exemplary aspects of collecting and displayingdata generated within a Healthcare Facility.

FIG. 3E illustrates the installation of wireless Nodes in a HealthcareFacility.

FIG. 3F illustrates an example of deployed wireless Nodes interactingwith an Agent in proximity to a door.

FIG. 4 illustrates a Node with wireless Transceivers useful for locationdetermination and data transceiving.

FIG. 5 illustrates Reference Point Transceivers useful for locationdetermination and data transceiving.

FIG. 6 illustrates apparatus that may be used to implement aspects ofthe present invention including executable software.

FIG. 6A illustrates an exemplary block diagram of a controller withangle of arrival and angle of departure functionality.

FIG. 6B illustrates exemplary block diagram of an assembly with multipleantenna arrays such as a “puck”

FIG. 6C illustrates another view of a puck with directional antennaarrays.

FIG. 7 illustrates an exemplary mobile Smart Device that may be used toimplement aspects of the present invention including executablesoftware.

FIGS. 8, 8A-8D illustrate a device and Vectors according to variousembodiments of the present invention.

FIGS. 9A-D illustrate exemplary antenna array design examples.

FIGS. 10A-C illustrate location determination with exemplary antennaarrays.

FIG. 11 illustrates a flow chart of method steps that may be executed insome implementations of the present invention.

FIG. 11A illustrates a user entering a room with a Smart Device, whereinthe room includes various and numerous wireless communicating devices.

FIG. 11B illustrates a map displayed on a Smart Device with CartesianCoordinates as well as Polar Coordinates displayed.

FIG. 12A illustrates a physical location with various stationary andmovable wireless Nodes including camera equipped devices.

FIG. 12B illustrates a view on a Smart Device incorporating a cameravideo display with superimposed wireless device location.

FIG. 12C illustrates a view on a Smart Device showing a map of knowndevice locations as well as known user location and user orientation.

FIG. 12D illustrates a view of devices displayed on a Smart Deviceshowing a map of known location equipped SVAN Node locations as well asregionally associated non-location equipped devices.

FIG. 12E illustrates a view of a SVAN displayed on a Smart Deviceshowing movement of known location Node locations as well as movement ofregionally associated non-location equipped devices.

FIG. 12F illustrates a view of a SVAN being used to look aroundblockages.

FIG. 13A illustrates a set of mobile Nodes represented in polarcoordinates.

FIG. 13B illustrates an ability of a set of mobile Nodes to cooperatearound blocked transmission zones with line of sight.

FIG. 14 depicts methodology related to the present invention.

FIG. 15 illustrates exemplary methods of computing the distance betweentwo Nodes not having line-of-sight communications between each other.

FIG. 16 illustrates methodology related to SVAN arrays deployed withnodes on, in or associated with vehicles.

FIG. 17 illustrates methodology related to SVAN arrays associated withAgents, materials, equipment, and structural aspects.

FIG. 18 illustrates method steps of some implementations of the presentinvention relating to occupancy of space.

FIGS. 19A and 19B illustrate exemplary cases for a smart device havingpucks containing directional antenna arrays that may be deployed at anincreased distance from a smart device and at alternative angles fromother pucks described in this disclosure.

FIG. 20 illustrates additional method steps that may be performed insome embodiments of the present invention.

FIG. 21 illustrates a block diagram of aspects of the present inventioninvolved in a process to virtually tag an item or location.

FIG. 22 illustrates still more method steps that may be performed insome embodiments of the present invention involving a virtual tag.

DETAILED DESCRIPTION

The present invention provides for improved Healthcare Facilitiesequipped with wireless transceivers that communicate with Nodes toprovide location and orientation of one or more of HCPs; equipment andresources and in some embodiments, a direction of interest of an HCP orother Agent via the operation of one or both of triangulation of Nodeswith reference point transceivers; and a spatially self-verifying arrayof Nodes.

According to the present invention, a position and orientation of one ormore of: doctors, nurse, technicians, transport personnel, or otherpersons associated with healthcare (sometimes referred to herein as a“healthcare provider” or “HCP”) are tracked. In addition, conditionswithin the Healthcare Facility are automatically quantified. Healthcareactivities are scheduled and tracked based upon the location andorientation of the HCPs and quantified conditions of one or both ofHealthcare Facility resources and equipment.

The present invention provides for automation that tracks who and whatis where, and a relative position and orientation of persons andequipment. The location and orientation of HCPs may be correlated to ahealthcare procedure to monitor who is located where and which directionthey are facing, before, during and after the healthcare procedure. Thepresent invention also provides for automation to monitor whichequipment was involved in a healthcare procedure and who operated suchequipment, a chronological order of equipment operation and relativetiming of actions taken during a procedure, including wait time duringwhich a person and/or piece of equipment is located and brought to asite of a procedure.

The current invention, not only records which HCPs were involved, butwhere each HCP stood/sat, and for how long, in which direction and inwhich sequence, and who operated which equipment, how long a piece ofequipment was operated and performance of the equipment. In addition,the present invention provides for quantification of conditions within aHealthcare Facility via automated transducers that convert anenvironmental condition into a digital value. Environment conditions mayinclude, by way of non-limiting example, one or more of: a temperature,a humidity, presence of a liquid, presence of a gas, a vibration, audiopatterns, airflow or other condition that may be monitored with anelectronic or electromechanical sensor.

Specifically, Nodes may include devices capable of wirelesscommunication in logical communication (e.g. a transmitter and one ormore antennas) with a processor and a digital storage. A position foreach Node may be generated based upon values for position determinationvariables. By comparing the values for position determination variablesbetween a single Node and multiple disparate Nodes, a position ofrespective Nodes in the array may be determined and verified.

In some embodiments, Nodes are co-located with an Agent and/or one ormore Sensors to quantify conditions within or proximate to HealthcareFacilities. Such Healthcare Facilities use Sensor groups to periodicallyand/or continuously quantify and transmit a current condition presentwithin the Healthcare Facility. Transmissions may be accomplished via awireless transceiver that may operate using a same or differentfrequency and modality as a frequency and modality used to determine aposition and orientation and/or direction of an Agent, HCP, equipmentitem or resource. Sensor readings may additionally be associated with atime index.

Various embodiments include methods and apparatus for planning ahealthcare event; identification of HCP's involved in the healthcareevent; designation of equipment and/or resources involved in ahealthcare event; as well as aspects of a Healthcare Facility, such asconstruction, Deployment and maintenance of a Healthcare Facility withIntelligent Automation (device, system, machine or equipment item)engaged in logical processes and Structural Messaging to communicateconditions within or proximate to the Healthcare Facility. StructuralMessaging includes logical communications generated by the IntelligentAutomation (such as a Sensor or machine) incorporated into, affixed to,or operated within or proximate to a Healthcare Facility.

In some aspects, a Sensor cluster (or a Sensor gateway, which may be aSensor cluster connected to a communications array) may be attached toor embedded into an item of equipment, a wall or other surface, such asan architectural aspect (e.g., a header, trim, and or a baseboard). TheSensors may be capable of quantifying a condition by generating adigital value based upon an environment in which the Sensor is placed.For example, sensor may be operative to quantify one or more of:vibration patterns, chemical presence, temperature, water presence,light waves or other indicia of a condition present. A remedial actiondevice may, based upon a reading from the Sensors, be actuated inresponse to a quantified condition.

In general, various embodiments of the present invention enable aHealthcare Facility, to be active as opposed to the former passivestate. The active state enables the Healthcare Facility to generate datadescriptive of one or more of: a location of a health care provider,technician, patient, other staff or visitor; a condition within aHealthcare Facility; a condition proximate to the Healthcare Facility;and an event experienced within the Healthcare Facility; and in someembodiments an active state Healthcare Facility is enabled to execute anaction via automation based upon a condition quantified by a sensorand/or a position and direction of one or both of an Agent and anequipment item. An action based upon automation may be executedindependent of Agent intervention, or based upon approval of an Agent,such as via an app on a Smart Device.

The present invention references prior applications and issued patentsowned by the applicant relating to automated apparatus and methods forgenerating improved Augmented Virtual Models (sometimes referred toherein as an “AVM”) of a Healthcare Facility. In some embodiments of thepresent invention, a Healthcare Facility AVM may include definedlocation of fixed aspects within the Healthcare Facility, such as, forexample, locations of resources and/or fixed location equipment withinthe Healthcare Facility.

Some aspects of an AVM of a Healthcare Facility may include a conceptualmodel and progress through one or more of: a) a design stage model; b) abuild stage model; c) a Deployment stage model; d) a service stagemodel; e) a modification stage model; and f) a dispensing stage model.An AVM according to the present invention may include original designdata matched to As Built data captured via highly accurate wirelesslocation, direction and elevation determination. As Built data may bematched with a time and date of data acquisition and presented intwo-dimensional (2D) and three-dimensional (3D) visual representationsof the Healthcare Facility. The augmented models additionally includedata relating to features specified in a Healthcare Facility design anddata collected during building, Deployment, maintenance andmodifications to the Healthcare Facility. In some embodiments, a fourthdimension of time may also be included.

An AVM may include a two, three or four-dimensional model in a virtualenvironment that exists parallel to physical embodiments modeled in theAugmented Virtual Model. The AVM exists in parallel to a physicalHealthcare Facility in that the AVM includes virtual representations ofphysical Healthcare Facilities and additionally receives and aggregatesdata relevant to the Healthcare Facilities over time. The aggregation ofdata may be one or more of: a) according to an event schedule (e.g.healthcare procedure); b) periodic; and c) in real time (without builtin delay).

The experience of events occurring within the Healthcare Facility, aswell as the physical Healthcare Facility is duplicated in the virtualAugmented Virtual Model. The AVM may commence via an electronic modelgenerated via traditional CAD software or other design type software. Inaddition, the AVM may be based upon values for variables, including oneor more of: usage of a Healthcare Facility; usage of resources and/orequipment within the Healthcare Facility; environmental factorsencountered during a build stage or Deployment stage of the HealthcareFacility; and metrics related to Performance of the Healthcare Facility.Metrics may be determined, for example, via measurements performed bySensors located on in and proximate to Healthcare Facilities located onthe Healthcare Facility.

In some embodiments, a virtual document library specific to a particularHealthcare Facility and location within the Healthcare Facility may bemaintained for each Healthcare Facility and made accessible to an onsiteHCP, technician and/or remote expert, or other Agent. The library mayinclude, but is not limited to details descriptive of: a HealthcareFacility design, equipment included in the Healthcare Facility, andtechnological capabilities of resources within the Healthcare Facility.Appropriate how-to videos may also be made available based upon alocation and orientation of an Agent within the Healthcare Facility.

In another aspect, a supplies ordering function may also be included inthe AVM and include suggested supplies based upon a location anddirection of interest. Supply ordering may allow a technician to viewsuggested supplies to have available during a scheduled procedure.

Aspects of the AVM may be presented via a user interface that maydisplay on a tablet; smartphone, personal computer or other userinteractive device, or in some embodiments be presented in a virtualreality environment, such as via an augmented reality headgear or avirtual reality headset.

Some exemplary embodiments may include updates to an AVM that includechanges to: equipment; resources; patients or Agents within theHealthcare Facility; time and date notation of a change in locationspecific data; a location of an item, equipment or resource or Agentupdated according to coordinates such as X,Y,Z coordinates, Cartesiancoordinates, distance data and/or an angle and distance data (or otherinformation pertinent to a chosen coordinate system); angle of arrival(AOA) of a wireless signal; angle of departure (AOD) of a wirelesssignal and the like. Location data may include hierarchical levels oflocation data, such as a high level location designation designating astreet address of a Healthcare Facility via triangulation and highlyspecific position designation (e.g., particular room and location withina room) determined via wireless radio communications and protocols, suchas WiFi RTT, Bluetooth, and sub-GHz communications.

In some preferred embodiments, a location will be determined based uponwireless communications with transceivers placed at accurately placedlocation reference points. The location reference points may be accessedduring activities within a Healthcare Facility or in close to aHealthcare Facility (e.g. parking lot).

In various embodiments, reference points may be designated using variouscommunication means, such as, by way of non-limiting example, a wirelesstransmission data transmitter operative to transmit an identifier andone or both of timing data and location data; a visual identifier, suchas a hash code, bar code, color code or the like; an infraredtransmitter; a reflective surface, such as a mirror; or other meanscapable of providing a reference point to be utilized in a triangulationprocess that calculates a precise location within the HealthcareFacility or other Healthcare Facility.

Highly accurate location position may be determined via automatedapparatus and multiple levels of increasingly accurate locationdetermination. A first level may include use of a GPS device providing areading to first identify a Healthcare Facility. A second level may useposition transmitters located within, or proximate to, the HealthcareFacility to execute triangulation processes in view of on-site locationreferences. A GPS location may additionally be associated with a highlevel general description of a Healthcare Facility, such as, one or moreof: an address, a unit number, a lot number, a tax map number, a countydesignation, Platte number or other designator. On-site locationreferences may include one or more of: wireless communication referencepoint transceivers; laser distancing transceivers; line of sight withphysical reference markers; patterned ID vehicle as bar code, hash tag,and alphanumeric or other identifier.

In some embodiments, triangulation may calculate a position within aboundary created by the reference points to within millimeter range, AOAand/or AOD and distance values may designate a polar and/or cylindricalcoordinate. In some embodiments, one or more of: Bluetoothtransmissions, WiFi RTT transmissions, sub GHZ transmissions,Differential GPS may be used to accurately determine a location of oneor more of: a location Tag, a Node, a Smart Device, an Agent, aresource, an item of equipment, or other identifiable item with a subcentimeter accuracy.

In addition to a position determination, such as latitude and longitude,or other Cartesian Coordinate (which may sometimes be indicated as an“X” or “Y” coordinate), Polar Coordinate, or GPS coordinate, the presentinvention provides for a direction of interest, and/or an orientation ofa device, such as a Smart Device or a headgear (sometimes referred toherein as a “Z” direction and elevation or “r”) of an item of interestwithin the AVM.

According to the present invention, a direction dimension (which mayinclude a direction of interest of an Agent and/or an orientation of adevice, may be based upon wireless communications with a single antennaor an antenna array attached to or incorporated into the device. Inaddition, in some embodiments, a device with a controller and anaccelerometer, such as mobile Smart Device, may include a user displaythat allows a direction to be indicated by movement of the device from adetermined location acting as a base position towards an item ofinterest in an extended position. Similarly, a device with a controllerand a laser (or other light based) distance and/or position indicatormay be used in combination with wireless transceivers to improveaccuracy of a location and direction or orientation determination.

In some implementations, the Smart Device may first determine a firstposition based upon triangulation with the reference points or angle ofwireless transmissions and timing values for wireless transmissions; anda second position (extended position) also based upon triangulation withthe reference points and/or angle of wireless transmissions and timingvalues. The process of determination of a position based upontriangulation with the reference points may be accomplished, for examplevia executable software interacting with the controller in the SmartDevice, such as, for example via running an app on the Smart Device.

In combination with, or in place of directional movement of a deviceutilized to quantify a direction of interest to a user, some embodimentsmay include an electronic and/or magnetic Directional Indicator that maybe aligned by a user in a direction of interest. Alignment may include,for example, pointing a specified side of a device, or pointing an arrowor other symbol displayed upon a user interface on the device towards adirection of interest.

In a similar fashion, triangulation may be utilized to determine arelative elevation of the Smart Device as compared to a referenceelevation of the reference points.

It should be noted that although a Smart Device is generally operated bya human user, some embodiments of the present invention include acontroller, accelerometer, data storage medium, Image Capture Device,such as a Charge-Coupled Device (“CCD”) capture device or an infraredcapture device being available in a handheld or unmanned vehicle orother Agent.

An unmanned vehicle may include for example, an unmanned aerial vehicle(“UAV”) or an unmanned ground unit (“UGA”), such as a unit with wheelsor tracks for mobility and a radio control unit for communication.

In some embodiments, multiple unmanned vehicles may capture data in asynchronized fashion to add depth to the image capture and/or athree-dimensional and four-dimensional (over time) aspect to thecaptured data. In some implementations, UAV/UGV position will becontained within a perimeter and the perimeter will have multiplereference points to help each UAV/UGV (or other unmanned vehicle)determine a position in relation to static features of a building withinwhich it is operating and also in relation to other unmanned vehicles.Still other aspects include unmanned vehicles that may not only capturedata but also function to perform a task, such as transport a patient,or other action. As stated throughout this disclosure a quantificationof a condition with the Healthcare Facility may be stored as digitaldata and stored in a digital storage for subsequent accessibility via aquery, structured or unstructured, AI Analysis, and/or incorporated intoan AVM of a Healthcare Facility.

In another aspect, captured data may be compared to an image library ofstored data using image recognition software to ascertain and/or affirma presence of particular HCPs, Agents or other persons, presence ofparticular equipment, a specific location, an elevation and a directionof an image capture location and proper alignment with the virtualmodel. Still other aspects may include the use of an accelerometer, alaser distance device, a compass, an audio based location device,incorporated into or in logical communication with a Smart Device.

In still other implementations, a line of sight from a Smart Device,whether user operated or deployed in an unmanned vehicle, may be used toalign the Smart Device with physical reference markers and therebydetermine an X,Y position as well as a Z position. Electronic altitudemeasurement may also be used in place of, or to supplement, a knownaltitude of a nearby reference point. This may be particularly useful inthe case of availability of only a single reference point.

Reference points may be coded via identifiers, such as a uniqueidentifiers, or UUID (Universally Unique Identifier), or otheridentification vehicle. Visual identifiers may include a bar code, hashtag, Alphanumeric or other symbol. Three-dimensional markers may also beutilized.

By way of non-limiting example, on site data capture may includedesignation of an X,Y,Z coordinate or angle and distance coordinate todescribe a reference position and one or more of: image capture;infrared capture; temperature; humidity; airflow; pressure/tension;electromagnetic reading; radiation reading; sound readings (e.g., levelof noise, sound pattern to ascertain equipment running and/or state ofdisrepair), and other vibration or Sensor readings (such as anaccelerometer or transducer).

In some embodiments, vibration data may be used to profile activitywithin a Healthcare Facility and/or operation of equipment and machineryassociated with the Healthcare Facility. For example, vibrationdetection may be used to determine a presence of a person or equipment,a type of activity taking place; equipment operation, includingautomated determination between proper operation of equipment andsuboptimal or faulty operation of the equipment.

According to the present invention, a Healthcare Facility is providedwith wireless Nodes capable of providing real time (without delay)position coordinates enabling succinct organization of healthcareprocedures and allocation of healthcare providers and other staff andAgents. In addition, conditions present during a healthcare procedureare quantified and stored so that the conditions and relative positionsof healthcare providers may be analyzed in view of success criteria inorder to provide best practices and resource allocation for a givenprocedure.

The Healthcare Facility is combined with multiple transceivers, (whichmay be incorporated into Nodes or separately deployed) the transceiversare deployed in or proximate to the Healthcare Facility to provide dataquantifying positions of the transceivers relative to each other and/ora Reference Point or other aspect of a Healthcare Facility.

In addition, Sensors may also be deployed with known positions relativeto one or more transceivers. The Sensors are operative to quantifyrespective conditions in an environment available to the sensor. Thedata quantifying respective conditions registered by the Sensors mayreferenced to generate a status and/or condition of one or more of: adeployed Healthcare Facility, a Healthcare Facility in the process ofbeing built; and/or a Healthcare Facility in the process of beingretrofitted with a position of quantified conditions determined basedupon use of a self-verifying array of Nodes.

In some embodiments, a location of one or more Sensors may be generatedbased upon wireless communications and represented as positioncoordinates, according to the methods herein. The location may be inrelation to one or more of: a home position; a position of an Agent; anda position of one or more Reference Position Transceivers. An Agent maybe guided to a Sensor and/or an area of interest based upon a Sensorreading using orienteering methods and apparatus presented herein. Forexample, a controller may receive Sensor data quantifying temperatureand humidity that exceed an optimal range of temperature and humidity.Using Orienteering, an Agent may be guided to one or both of the Sensorsthat generated the data and an area of interest indicated by themeasured data. A user interface may include human ascertainableindications of the conditions quantified and/or the location of theconditions quantified.

Additional examples may include guiding an Agent to a Sensor to replacea power source, such as a battery or battery pack. Other exemplary powersources include an antenna or array of antennas tuned to receive ambientenergy and recharge an energy storage device (such as a battery).

Referring now to FIGS. 1A and 1B, a relational view of an AVM 100 of aVirtual Healthcare Facility 101B is illustrated, as well as a physicalHealthcare Facility 101A. The AVM 100 includes a virtual model stored indigital form that is functional to model a healthcare procedureincluding one or more of: patient location(s); patient transport; HCPsinvolved; technicians involved; nurses involved, equipment involved,resource involved, all modeled in a virtual environment. The VirtualHealthcare Facility 101B and the AVM 100 may reside in a virtual settingvia a controller 108 operative via executable software stored a digitalstorage medium 104 that is in logical communication with the controller108. The controller 108 will typically include one or more computerprocessors as described more fully below, and may be accessible viadigital networking protocols. The AVM 100 may be accessible via a userinterface 101 on a smart device 106A-B.

The physical Healthcare Facility 101A may include Nodes 102 or othertype of wireless transceiver that may incorporate, or be co-locatedwith, one or more Sensors that quantify a position or condition(s) in aphysical area within the Healthcare Facility 101A, which may bedesignated, for example, as a resource 102C. Reference PointTransceivers 121A may be used as wireless references of a geospatialposition. A Gateway Node 102 may link logical infrastructure within theHealthcare Facility 101A with a digital communications network, such asthe Internet or a private network.

The present invention provides for wireless tracking of Agents 105A-105E(e.g. a technician 105A; an HCP 105B, a nurse 105C, a transport 105D,and a coordinator 105E) as well as other staff and Agents, prior to,during and subsequent a Healthcare procedure. Wireless tracking,according to the methods and apparatus of the present invention,includes generation of a position of each Agent 105A-105E and anorientation of each Agent 105A-105E and may also include a direction ofinterest designated by an Agent 105A-105E.

The present invention allows for scheduling of Agents 105A-105E to bepresent at a designated resource 102C, such as an operating room, thatis a portion of a Healthcare Facility 102A. The present invention alsoprovides for generating a position of each scheduled Agent 105A-105Ecapable of ascertaining the presence of each of the scheduled Agents105A-105E at a designated resource 102C during a procedure.

In addition, as a procedure progresses, an additional Agent 105D may besummoned via wireless communication to come to the resource 102.Orienteering methods may be used to provide a wireless guidanceinterface 106A to the Agent 105D that calculates a starting position109A and a destination position 109B and a path 109 to get the Agentfrom the starting position 109A to the destination position 109B.

Wireless positioning and orientation and direction of interestdesignations may be generated relative to reference point transceivers121 fixedly located within or proximate to the Healthcare Facility 101A.Positioning data and/or Sensor 102 quantification data may betransmitted to a gateway 110 that receives the Positioning data and/orSensor 102 quantification data via a first wireless wavelength andmodality and transmits the Positioning data and/or Sensor 102quantification data to a controller via a wavelength and/or modality.For example, the Positioning data and/or Sensor 102 quantification datamay be transmitted to the gateway 110 via Bluetooth and/or WiFi and/orsub-GHz wavelengths and transmitted from the Gateway 110 to a controller108 via Internet Protocol, cellular transmission and/or satellitetransmission.

A healthcare procedure administrator 105E or other Agent or user mayaccess the AVM 100 to monitor progression of healthcare procedures;locations of patients 105E and/or Agents 105A-105D, as well as monitorconditions quantified via a sensor 114, operation of an equipment item112, a location tags 111A,111B, 111C and 111D positions.

The Virtual Healthcare Facility 101B may include one or both of:historical data and most current data relating to aspects viewable orproximate to a user device 106A while the user device 106A is at thecalculated location in the physical Healthcare Facility 101A. In thisway, the parallel virtual world of the AVM 100 and the VirtualHealthcare Facility 101B may present data from the virtual world thatemulates aspects in the physical world, and may be useful to the useraccessing the user device 106A, while the user device 106A is at aparticular physical location.

As Sensors 102 quantify conditions within the Healthcare Facility 101A,the conditions are memorialized as digital data (sometimes referred toas Experiential Data) associated with a physical Healthcare Facility101A.

In some embodiments, a Sensor 102A may quantify one or more biometricconditions present in an Agent 105D, or other person, that is about toenter a resource 102C or Healthcare Facility 101A involved in ahealthcare procedure. For example, in some embodiments, a Sensor 101Amay quantify a biometric that includes: body temperature, pulse rate,breathing rate, blood pressure reading, or other biologic and/orcorporeal condition. In such embodiments, a person with a condition thatexceeds a designated range for a biometric condition, such as, forexample, a person with a fever and/or elevated heartrate may be deniedaccess to the resource 102C or Healthcare Facility 101A or otherstructure or facility, in order to protect the patient 105F or otherpersons 105A-105C present from a bacteria or virus infection that may becausing the biometric condition. A physical location tag 111E and/orvirtual location tag may be used to determine that an Agent 105D isabout to enter a defined area, such as a Healthcare Facility 101A or aresource 102C, or other room or defined area.

Similarly, in some embodiments, a physical location tag 111A and/orvirtual location tag may be used to determine an Agent 105A positionedto operate an item of equipment 112 or interface device 115. In someembodiments, an Agents location and orientation may be determined viathe teachings herein and a controller may conclude that the Agentlocation and orientation supports that the Agent 105A is operating theitem of equipment 112. A record may be stored in a digital storage 104memorializing that the Agent 105A was in control of the equipment item112 at a recorded time and on a recorded date.

In addition, Sensors 114 may quantify one or more conditions present inthe Healthcare Facility 101A and the quantified condition as may bestored as Experiential Data in the digital storage 104. The ExperientialData may be retrieved via structured and/or unstructured queries and mayalso be analyzed with unstructured queries and/or artificialintelligence processes.

In some embodiments, Experiential Data may also be associated with anAgent interacting with the equipment item 112 and/or the HealthcareFacility 101A. A Healthcare Facility may be modified to optimally carryout a prescribed function, such as performance of a healthcare procedurewithin the Healthcare Facility 101A. Conditions associated with Agents105A-105D may be quantified with Sensors 102 that are located on orproximate to the Agents 105A-105D. Alternatively, Sensors 124 locatedin, or proximate to, a Healthcare Facility 101A may be used to monitorhuman variability. Biosensors may be used to provide empirical data ofhumans 118 interacting with a Healthcare Facility may be analyzed usingstructured or unstructured queries to device relationships betweenHealthcare Facility Performance and human biometrics.

Accordingly, Sensors 102 may be used to quantify interaction between anAgent 105A-105D and an item of equipment 112 and/or the HealthcareFacility 101A according to physiological and behavioral data,interactions, and environmental factors within the Healthcare Facility,actions undertaken, movements, and almost any quantifiable aspect may bequantified and converted to digital values and stored for future access.

As Built Features and biometrics may be further utilized to controlvarious Healthcare Facility automation devices. Healthcare Facilityautomation devices may include, by way of non-limiting example one ormore of: healthcare equipment items 112, automated locks or othersecurity devices; thermostats, lighting, heating, and the like.Similarly, a Healthcare Facility 101A with recorded vibration Sensorsmay track activities in the Healthcare Facility 101A and determine thata particular activity is taking place, or that a particular Agent105A-105D associated with a particular vibration pattern of walking (orother travel mode) is moving within the Healthcare Facility.

Moreover, as a healthcare procedure is being performed on a patient 105Fin a particular resource 102C, patient biometric data and physicalcondition, as well as procedure metrics may be correlated with positionsand/or orientations of Agents 105A-105D and/or equipment 112 during theHealthcare Procedure.

A Healthcare facility may be programmed to execute a remedial action inresponse to a condition quantified by a Sensor. By way of non-limitingexample, vibration patterns may indicate that a particular orunidentified Agent 105A-105D is walking down a hallway and automaticallyturn on appropriated lighting and adjust one or more of: temperature,sound, and security. Security may include locking doors for which personone is not programmed to access. For example, a first pattern ofvibration may be used to automatically ascertain that an Agent 105A-105Eis traversing an area of a Healthcare Facility for which a high level ofsecurity is required or an area that is designated for limited accessdue to safety concerns. Other Healthcare Facility automation may besimilarly deployed according to occupant profiles, biometric data, timeof day, or other combination of available Sensor 102 generated data.

In some implementations, an augmented reality headgear, a virtualreality headset or other headgear may be worn by an Agent 105A-E toprovide one or both of an augmented setting or an immersive experiencefrom a Vantage Point 122A such that the Agent 105A-105B may combinevirtual and physical input based upon being located at the Vantage Point122A within the Healthcare Facility 101A at a specified point in time.

In still another aspect of the present invention, in some embodiments, adisplay screen 116 may be located within a resource or another locationin the Healthcare Facility 101A to apprise Agents 105A-105B ofconditions present within the Healthcare Facility 101A. The displayscreen may include user interactive portions that allow an Agent105A-105B to query the digital storage 104 and or enter a command orother instruction or manually input data. In some embodiments, a displayscreen 116 may track steps included in a healthcare procedure andprovide an indication of completion of steps as each respective step isconcluded. The display may also indicate which Agent 105A-105B hascompacted to complete a step and where the Agent 105A-105B was locatedand how the Agent 105A-105B was oriented during completion of the step.The display may still additionally display steps that are queued to beexecuted and an Agent scheduled to complete one or more queued steps.

Still further, the display 116 or an Agent supported Smart Device106A-106B may be operated to request assistance from an Agent 105D thatis not present in the resource 102C. A wireless communication may beused to summon the Agent 105D and to also provide Orienteeringinstructions on how to arrive at the resource 102E.

Referring now to FIG. 1C, a block diagram illustrates various aspects ofthe present invention and interactions between the respective aspects.The present invention includes a healthcare procedure 111 of aHealthcare Facility that includes suggested procedure steps as well asAgents that will be involved in the procedure steps. A procedure stepsare tracked via Sensors and Agent actions based upon location anddirection-specific data capture. Data may be transmitted and receivedvia one or both of digital and analog communications, such as via awireless communication medium 127.

According to the present invention, one or more Procedure PerformanceMetrics 122 are entered into automated controller in logicalcommunication with a controller or smart device containing stepsincluded in the healthcare procedure 111. The Procedure PerformanceMetrics 122 may essentially include a purpose to be achieved duringhealthcare procedure that is performed in a Healthcare Facility. By wayof non-limiting example, a Procedure Performance Metric may include oneor more of: an improved health condition of a patient, repair of amalfunctioning body part, removal of a diseased or malignant body part,insertion of an artificial body part, application of a therapeuticsubstance, application of therapeutic energy, imaging of a body part,birth of a child, surgery, therapeutic manipulation of body parts,diminishment of pain levels, increased physical performance, improvedbiological functions or other procedure.

Modeled Performance Levels 123 may also be entered into the controllerin logical communication with the healthcare procedure 111. The ModeledPerformance Levels 123 may include an appropriate level of performanceof an aspect of the Healthcare Facility. For example, a PerformanceLevel 123 for a Healthcare Facility modeled may include one or more of:a threshold number of successfully completed procedures or treatment ofpatients, achievement of quality assurance goals, adherence to customarycare standards and achievement of a daily or monthly utilization ofhealthcare equipment. Similarly, a target patient satisfaction, employeefeedback, financial goal or other metric may be included.

Empirical Metrics Data 124 may be generated and entered into theautomated apparatus on an ongoing basis. The Empirical Metrics Data 124will relate to one or more of the Procedure Performance Metrics and maybe used to determine compliance with a Procedure Performance Leveland/or a Performance Levels. Empirical Metrics Data 124 may include, byway of non-limiting example, adherence to quality assurance procedures,maintenance of equipment schedules, environment cleanliness, employeeabsenteeism, patients who experience an improvement in health,achievement of safety goals or other measurable items.

In addition to Empirical Metrics Data 124, Lead Actions and expected LagBenefits 125 that may cause an effect on one or both of a ProcedurePerformance Level 112 and a Performance Level 123, may be entered intothe automated apparatus. A Lead Action may include an action expected toraise, maintain or lower an Empirical Metrics Data 124. For example, anaction to quickly and thoroughly clean a resource following a procedureand make it deployable for a next patient and healthcare procedure maybe scheduled based upon relative locations of healthcare providingAgents and Sensor readings. Other Lead Actions may include limitingaccess to a Healthcare Facility of person with certain biometricreadings, such as an elevated body temperature, elevated heart rate,coughing or sneezing. An expected benefit may be measured in Lag Benefitmeasurements, such as those described as Empirical Metrics Data 124, orless tangible benefits, such as patient and employee satisfaction.

The automated apparatus may also be operative to calculate FuturePerformance 126 based upon one or more of: relative positions of Agentsduring a procedure, time of day of a procedure, day of week of aprocedure, time of year of a procedure, which resource is occupiedduring a procedure, which healthcare facility is occupied during aprocedure, which Agents perform procedure steps, which teams of Agentsperform a procedure, which equipment is used to complete a procedure;equipment maintenance schedules, environmental conditions in a resourceduring a procedure, biometric conditions measured in a patient and/orhealthcare practitioners during a procedure; Procedure PerformanceMetrics 122; Modeled Performance Levels 123 and Empirical Metrics Data124. Future Performance may be calculated in terms of an achievement ofa procedure performance metric based upon conditions quantified bySensors, positions of Agents, which Agents are present, procedure stepsexecuted and any other of the variables discussed herein.

Referring now to FIG. 1D a user 131 is illustrated with a field of viewthat may be simulated via a user interface with an AVM 100 (not shown inthis Figure). The user interface may be immersive, such as, for example,a virtual reality interface; or the interface may provide augmentedreality, wherein a user is provided data related to a user environmentor a vantage specified by the user. The user 131 may be virtuallylocated at a Vantage Point 137 and may receive data 136, including, butnot limited to one or more of: image data 134, audio data 135 andambient environment data 136. The user 131 may also be provided withcontrols 133. Controls 133 may include, for example, zoom, volume,scroll of data fields and selection of data fields. Controls may beoperated based upon an item of Equipment 132 within a Field of View 138of the User 131 located at a Vantage Point 137 and viewing a selecteddirection (Z axis). The user is presented with Image Data from withinthe AVM 111 that includes As Built data and virtual design data.

Examples of content included in a virtual and/or augmented model includedata generated by one or more of: Sensor arrays, audio capture arraysand camera arrays with multiple data collection angles that may becomplete 360 degree camera arrays or directional arrays, for example, insome examples, a Sensor array (including image capture Sensors) mayinclude at least 120 degrees of data capture, additional examplesinclude a Sensor array with at least 180 degrees of image capture; andstill other examples include a Sensor array with at least 270 degrees ofimage capture or 360 degrees of image capture. In various examples, datacapture may include Sensors arranged to capture image data in directionsthat are planar, oblique, or perpendicular in relation to one another.

Referring now to FIG. 1E, in some examples, a tablet, handheld networkaccess device (such as, for example a mobile phone) or other device withone or more antennas and a transceiver may be used to determine ageneral location of a physical Healthcare Facility 101A. For example, asmart phone with global positioning system (GPS) or cellularcommunication capabilities may be used to determine a physical addressof a physical Healthcare Facility, such as 123 Main Street. Storedrecords containing data relating to 123 Main Street may be accessed viathe Internet or other distributed network.

In addition to the use of GPS to determine a location of a Smart Device,the present invention provides identification of a real estate parcel140-142 with a physical Healthcare Facility 140A-142A based uponwireless communications with one or more satellites, cell towers, subGHz transmitters or other long distance wireless communication. TheHealthcare Facility may in turn include one more radio frequency (orother mechanism) location identifiers. Location identifiers (see item121 in FIG. 1A-B) may include, for example, radio transmitters at adefined location that may be used to accurately identify viatriangulation, a position of a user device 106, such as a: tablet, smartphone, or virtual reality device. The position may be determined viatriangulation, single strength, time delay determination or otherprocess. In some embodiments, triangulation may determine a location ofa user device within millimeters of accuracy.

Other location identifiers may include, by way of non-limiting example,RFID chips, a visual markings (e.g., a hash tags or barcode), pins, orother accurately placed indicators. Placement of the locationidentifiers may be included in the AVM and referenced as the location ofthe physical user device is determined. As described above, specificlocation identifiers may be referenced in the context of GPS coordinatesor other more general location identifiers.

Based upon the calculated location of the user device 106, details ofthe physical Healthcare Facility 101A may be incorporated into theVirtual Healthcare Facility 101B and presented to a user via a graphicaluser interface (GUI) on the user device 106.

For example, a user may approach a physical Healthcare Facility andactivate an app on a mobile user device 106. The app may cause the userdevice 106 to activate a GPS circuit included in the user device anddetermine a general location of the user device 106, such as a streetaddress designation. The general location will allow a correct AVM 100to be accessed via a distributed network, such as the Internet. Onceaccessed, the app may additionally search for one or more locationidentifiers 121A of a type and in a location recorded in the AVM. An AVMmay indicate that one or more RFID chips are accessible at an ingressinto a Healthcare Facility. The user may activate appropriate Sensors toread the RFID chips and determine their location. In another aspect, anAVM 100 may indicate that location identifiers 121A are placed at two ormore corners (or other placement) of a physical Healthcare Facility 101Aand each of the location identifiers 121A may include a transmitter witha defined location and at a defined height. The user device 106, orother type of controller, may then triangulate with the locationidentifiers 121A to calculate a precise location and height within thephysical Healthcare Facility.

In still another aspect of the present invention, in some embodiments,transmissions from one or more location identifiers 121A may becontrolled via one or more of: encryption; encoding; passwordprotection; private/public key synchronization; or other signal accessrestriction. Control of access to location identifiers 121A may beuseful in multiple respects, for example, a location identifier mayadditionally function to provide access to data, a distributed networkand/or the Internet.

As illustrated in FIG. 1E, a map of real estate parcels 140-143 is shownwith icons 140A-142A indicating parcels 140-142 that have virtualHealthcare Facilities 140A-142A included in a virtual model associatedwith the parcels. Other parcels 143 have an indicator 143A indicatingthat a virtual model is in process of completion.

In some methods utilized by the present invention, data in an AVM may beaccessed via increasingly more accurate determinations. A first level ofgeospatial location determinations may be based upon the real estateparcels 140-143 themselves and a second geospatial determination may bemade according to Reference Position Transceivers (discussed more fullybelow) included within the boundaries of the real estate parcels140-143. Still more accurate location position may be calculatedaccording to one or both of a direction determination and anaccelerometer or other location determination technology. Accordingly,it is within the scope of the present invention to access a record of adesign model for a specific wall portion within a Healthcare Facilitybased upon identification of a particular parcel of real estate parcels140-143 and a location within a Healthcare Facility situated within thereal estate parcels 140-143 and height and direction. Likewise, thepresent invention provides for accessing As Built data and the abilityto submit As Built data for a specific portion of a Healthcare Facilitybased upon an accurate position and direction determination.

For example, in some embodiments, a first level of locationidentification may include a real estate parcel 140-143 identified basedupon a first wireless communication modality, such as a GPScommunication or a sub-GHz wavelength communication. A second level oflocation identification may include a Healthcare Facility 141A-143Aidentified via one or more of GPS; UWB; Wi-Fi; sonic communications; asub-GHz wavelength communication and Bluetooth communications. A thirdlevel of location identification may include an Agent position within aHealthcare Facility (or Healthcare Facility) based upon logicalcommunications via one or more of: UWB; Wi-Fi; sonic communications; andBluetooth communications. A fourth level of location identification mayinclude a determination of a distance from an item to a Smart Deviceborne by an Agent, the distance determination may be based upontransceiving in a SVAN operating in a Bluetooth wavelength, a WiFiwavelength or a sub-GHz wavelength.

In some implementations of the present invention, a HealthcareFacility-unique identifier may be assigned by the AVM and adhere to astandard for universally unique identifiers (UUID), other uniqueidentifiers may be adopted from, or be based upon, an acknowledgedstandard or value. For example, in some embodiments, a unique identifiermay be based upon Cartesian Coordinates, such as global positioningsystem (GPS) coordinates. Other embodiments may identify a HealthcareFacility according to one or both of: a street address and a tax mapnumber assigned by a county government or other authority.

In some embodiments, an AVM may also be associated with a larger groupof Properties, such as a manufacturing plant, research and development,assembly, a complex, or other defined arrangement.

As illustrated, in some preferred embodiments, an electronic recordcorrelating with a specific Healthcare Facility may be identified andthen accessed based upon coordinates generated by a GPS device, or otherelectronic location device. The GPS device may determine a location andcorrelate the determined location with an AVM record listing model data,As Built data, improvement data, Performance data, maintenance data,cost-of-operation data, return-on-investment data and the like.

In another aspect, data generated by Sensors deployed in a HealthcareFacility may be aggregated and analyzed according to a HealthcareFacility location and/or Healthcare Facility location associated withthe Sensor/Sensor Cluster/Sensor Gateway. In this manner, an event maybe tracked in a larger geographic area with numerous data points. Forexample, an event such as the launch of a rocket may cause data to begenerated by multiple Sensor/Sensor Cluster/Sensor Gateways and trackedacross a geographic area. Similarly, a natural event, such as anearthquake, hurricane, wildfire and the like may be tracked with highlyaccurate Sensor data across tens, hundreds or many thousands of datapoints. Still other events may include, for example, power usage, powergeneration, water flow in a hydroelectric system, water management in areservoir system, flooding, release of toxic components into theenvironment, etc.

Referring now to FIG. 2, a functional block illustrates variouscomponents of some implementations of the present invention. Accordingto the present invention, automated apparatus included in the AVM 201are used to generate a model of a Virtual Healthcare Facility and mayalso incorporate a model and associated real estate parcel. One or morepieces of equipment that will be deployed in the Healthcare Facility maybe included into the AVM 201. This equipment may include, for example:equipment 211; building support items 212, and utilities support 213.The AVM 201 may model operational levels 204 during deployment of aHealthcare Facility and associated machinery and equipment included inthe AVM 201. Machinery 211 may include, by way of non-limiting example:imaging machines, life support, radiation treatment equipment,purification equipment, sterilization equipment, oxygen supplyequipment, medical procedure support equipment, Healthcare Facilityautomation, air purification or filter systems, noise containment deviceand any other equipment conducive to performing a successful healthcareprocedure. Utility support equipment may include cabling, Wi-Fi, waterfilter, chemical supply, gas supply, compressed air supply and the like,as well as uptime and downtime associated with a Healthcare Facilityutility and uptime and down time 243 of one or more aspects of theHealthcare Facility.

The AVM 201 calculates a predicted Performance of the AVM and generatesOperational Levels 204 based upon the Performance 222, wherein“Performance” may include one or more of: total cost of Deployment 214;operational experience 203 which may include one or both of: objectiveempirical measurements and satisfaction of a patient's experience in theHealthcare Facility, operational expectations 204, total maintenancecost 206, and residual value of an As Built Healthcare Facilityfollowing a term-of-years of occupation and use of an As BuiltHealthcare Facility based upon the AVM. Performance 221 may also beassociated with a specific item of equipment 211.

In another aspect, actual Operational Experience 203 may be monitored,quantified and recorded by the AVM 201. Data quantifying the OperationalExperience 203 may be collected, by way of non-limiting example, fromone or more of: Sensors incorporated into an As Built HealthcareFacility; maintenance records; utility records indicating an amount ofenergy 202 (electricity, gas, heating oil) consumed; water usage;periodic measurements of an As Built Healthcare Facility, such as aninfrared scan of climate containment, air flow through air handlers,water flow, water quality and the like; user surveys and maintenance andreplacement records.

In still another aspect, a warranty 205 covering one or both of partsand labor associated with an As Built Healthcare Facility may betracked, including replacement materials 207. The warranty 205 may applyto an actual Healthcare Facility, or one or more of equipment 211;building support 212 item; and utility support item 213.

The AVM 201 may consider a proposed usage of a deployment of aHealthcare Facility based upon values for Deployment variables andspecify aspects of one or more of: equipment 211; building support 212;and utility support 213 based upon one or both of a proposed usage andvalues for Deployment variables. Proposed usage may include, forexample, how many resource Agents will occupy a Healthcare Facility,demographics of the resources that will occupy the Healthcare Facility;percentage of time that the Healthcare Facility will be occupied;whether the Healthcare Facility is a leased Healthcare Facility andtypical duration of leases entered into; and environmental conditionsexperienced by the Healthcare Facility, such as exposure to ocean salt,winter conditions, desert conditions, high winds, heavy rain, highhumidity, or other weather conditions.

In another aspect, Deployment may relate to biometrics or other dataassociated with specific occupants of a Healthcare Facility.Accordingly, in some embodiments, Sensors may monitor biologicallyrelated variables of patients and/or proposed use patients. Thebiometric measurements may be used to determine one or both of LeadActions and Lag Metrics. Lead Actions may include one or more of: use ofspecific materials, selection of design aspects; Deployment ofHealthcare Facility equipment; Deployment of machinery; terms of alease; length of a lease; terms of a maintenance contract; andHealthcare Facility automation controls.

According to the present invention, design aspects and HealthcareFacility materials 210 may also be based upon the proposed usage andvalues for Deployment variables. For example, a thicker exterior wallwith higher insulation value may be based upon a Healthcare Facility'slocation in an adverse environment. Accordingly, various demographicconsiderations and proposed usage of a Healthcare Facility may be usedas input in specifying almost any aspect of a Healthcare Facility.

In still another consideration, a monetary value for one or more of: aTotal Cost of Deployment (“TCD”). Total Maintenance Cost (“TMC”) and adesired return on investment (“ROI”) for a Healthcare Facility may beused as input for one or more design aspects included in an AVM System200. Total Cost of Ownership, TCD, TMC, and ROI may be used to determineoptimal values of variables 202-205, 210-213 specified in an AVM System200 and incorporated into an As Built Healthcare Facility, and otherimprovements to a real estate parcel.

A Total Cost of Deployment 214 may change based upon a time period 215used to assess the Total Cost of Deployment 214. A ROI may include oneor more of: a rental value that may produce a revenue stream, a resalevalue, a cost of operation, real estate taxes based upon HealthcareFacility specifications and almost any other factor that relates to oneor both of a cost and value.

Desirable efficiency and Performance may be calculated according to oneor more of: established metrics, measurement protocols, and pastexperience. The AVM 201 and associated technology and software may beused to support a determination of a TCD. In another aspect, a TCD maybe based upon an assembly of multiple individual metrics, procedures toassess metrics, procedures to adjust and optimize metrics and proceduresto apply best results from benchmark operations. In the course ofmanaging Total Cost of Ownership, in some examples, initial steps mayinclude design aspects that model an optimal design based upon TotalCost of Ownership metrics.

In the following examples, various aspects of Total Cost of Deployment214, Total Maintenance Costs, and associated metrics, are considered inthe context of calculating a target Total Cost of Deployment 214.Accordingly, the AVM may be used to attempt to optimize TCD based on oneor more measured variables.

A designed Healthcare Facility is ultimately built at a site on a realestate parcel. A build process may be specified, which may providemetrics that may be used in a process designed by an AVM 201 and alsoused as a physical build proceeds. In some examples, time factorsassociated with a physical build may be important, and in some examplestime factors associated with a physical build may be estimated,measured, and acted upon as they are generated in a physical buildprocess. Examples of time factors may include one or more of: a time todevelop and approve site plans; a time to prepare the site and locatecommunity provided utilities or site provided utilities; a time to layfoundations; a time to build Healthcare Facility; a time to finishHealthcare Facility; a time to install internal utilities and facilitiesrelated aspects; a time to install, debug, qualify and releaseequipment; and times to start production runs and to certify complianceof production are all examples of times that can be measured by varioustechniques and sensing equipment on a Healthcare Facility's site.Various time factors for a build are valuable and may becomeincreasingly valuable as a physical build proceeds since the monetaryinvestment in the project builds before revenue flows and monetaryinvestments have clearly defined cost of capital aspects that scale withthe time value of money.

Various build steps may include material flows of various types.Material flow aspects may be tracked and controlled for cost andefficiency. Various materials may lower a build materials cost but raisetime factors to complete the build. Logical variations may be calculatedand assessed in an AVM 201 and optimal build steps may be generatedand/or selected based upon a significance placed upon various benefitsand consequences of a given variable value. Physical build measurementsor Sensor data on physical build projects may also be used as input inan assessment of economic trade-offs.

The equipment deployed may incur a majority of a build cost dependingupon user-defined target values. The AVM may model and presentalternatives including one or more of: cost versus efficiency, quality240, time to build, life expectancy, market valuation over time. A costto build may be correlated with cost to deploy and eventual resale. Anoverall model of a Total Cost of Deployment 214 may include any or allsuch aspects and may also include external. In some examples, the natureof equipment trade-offs may be static, and estimations may be made fromprevious results. In some other examples, changes in technology,strategic changes in sourcing, times of acquisition, and the like mayplay into models of Total Cost of Deployment 214.

In some examples, an initial efficiency of design that incurs largecosts at early stages of a project may have a dominant impact on TotalCost of Deployment 214 when time factors are weighted to real costs. Inother examples, the ability of a Healthcare Facility to be flexible inits deployment or build order over time and to be changed in suchflexible manners, where such changes are efficiently designed maydominate even if the initial cost aspects may be less efficient due tothe need to design-in flexibility. As a Healthcare Facility is built,and as it is operated the nature of changing customer needs may createdynamic aspects to estimations of Total Cost of Deployment 214.Therefore, in some examples, estimates on the expected dynamic nature ofdemands on a Healthcare Facility may be modeled against the cost aspectsof flexibility to model expectations of Total Cost of Deployment 214given a level of change.

In some examples, factors that may be less dependent on extrinsicfactors, such as product demand and the like may still be importantmetrics in Total Cost of Deployment 214. Included in the As Builtfactors may be calculations such as HVAC temperature load, in whichpersonnel and seasonal weather implications may be important. AVM modelsmay include a user interface to receive value useful in the AVM models.In addition, electronic monitoring, via Sensors that may determineenergy consumption, includes for example monitoring any of: electricity,fuel oil, natural gas, propane and the like.

Temperatures may be monitored by thermocouples,semiconductor-junction-based devices or other such direct-measurementtechniques. In other examples, temperature and heat flows may beestimated derived from photon-based measurement, such as surveying theHealthcare Facility with infrared imaging or the like.

Utility load may be monitored on a Healthcare Facility-wide basis and/orat point-of-use monitoring equipment located at hubs or individualpieces of equipment themselves. Flow meters may be inline, or externalto, features such as pipes, wires, or conduits. Gas and liquid flows maybe measured with physical flow measurements or sound-based measurement.In other examples, electricity may be monitored as direct currentmeasurements or inferred-inductive current measurement.

In some examples, the nature and design of standard usage patterns of aHealthcare Facility and an associated environment may have relevance toTotal Cost of Ownership. For example, usage that includes a largernumber of ingress and egress will expose an HVAC system to increasedload and usage that includes a significant number of waking hours withinhabitants in the building may incur increased usage of one or more of:equipment 211; building support devices 212; and utilities 234.

The nature and measurement aspects of vibration in the HealthcareFacility may also be modeled and designed as the Healthcare Facility isbuilt. There may be numerous means to measure vibrations fromcapacitive- and resistive-based measurements to optical-basedmeasurements that measure a subtle change in distance scale as a meansof detecting vibration. Vibration may result from a Healthcare Facilitybeing located proximate to a roadway, train, subway, airport, tidalflow, or other significant source of relatively consistent vibration.Vibration may also be more periodic, such as earthquake activity. Instill another aspect, vibration may result from human traffic within theHealthcare Facility. The use of vibration-monitoring Sensors mayindicate various activities that take place within the HealthcareFacility and facilitate more accurate modeling of a life expectancy ofvarious aspects of the Healthcare Facility as well as machines locatedwithin the Healthcare Facility.

Noise levels are another type of vibrational measurement which isfocused on transmission through the atmosphere of the HealthcareFacility. In some cases, noise may emanate from one location aftermoving through solid Healthcare Facility from its true source at anotherlocation. Thus, measurement of ambient sound with directionalmicrophones or other microphonic sensing types may be used to elucidatethe nature and location of noise emanations. In some cases, other studyof the noise emanations may lead to establishment of vibrationalmeasurement of different sources of noise. Floors, ceilings, doorways,countertops, windows, and other aspects of a Healthcare Facility may bemonitored in order to quantify and extrapolate noise levels. Noise andvibrational measurement devices may be global and monitor a region of aHealthcare Facility, or they may be inherently incorporated into or uponindividual equipment of the Healthcare Facility.

In some examples, models of a Healthcare Facility (including originalmodels and As Built models) may include routings of pipes, wires,conduits and other features of a Healthcare Facility and the installedequipment that have Healthcare Facility. Together with models of thebuilding Healthcare Facility and the equipment placed in the buildingthe various routed Healthcare Facilities may be married in a detailed anAVM 201.

In another aspect, an AVM 201 may include conflicts between aspectsincluded in the physical Healthcare Facilities may be detected andavoided in the design stage at far improved cost aspects. In someexamples, a designer may virtually ascertain a nature of the conflictand alter a design in virtual space to optimize operational aspects.Additionally, in some embodiments, an As Built model may be generatedduring and after a Healthcare Facility is built for various purposes. Insome examples, a technician may inspect a Healthcare Facility forconformance of the build to the designed model. In other examples, as anAs Built Healthcare Facility is altered to deal with needed changes,changes will be captured and included in the As Built AVM 201.

In another aspect of the present invention, the AVM 201 may be used togenerate a virtual reality model of a Healthcare Facility, including oneor more Healthcare Facilities that may be displayed via user interfacethat includes an immersion of the user into a virtual setting. Immersionmay be accomplished, for example, via use of a virtual reality headsetwith visual input other than a display screen is limited. In someembodiments, a virtual setting may be generated based upon a location ofthe user. For example, GPS coordinates may indicate a HealthcareFacility and a user may wear a headset that immerses the user in avirtual reality setting. The virtual reality setting may display one ormore virtual models of Healthcare Facilities that may be potentiallyconstructed on the Healthcare Facility.

Embodiments may include models generated using, for example, standardmodeling software such as BIM 360™ field which may support the displayof a Healthcare Facility design in a very complete level of detail.Modeling of a Healthcare Facility in its location or proposed location,or in multiple proposed locations, may be useful from a Total Cost ofOwnership perspective, especially from an evaluation of the nature of asite layout including real estate Healthcare Facility parcel options andthe like.

In some examples, a virtual display observed in the field at the site ofan As Built or proposed build may allow for design changes and designevaluations to be viewed in a space before build is completed. Forexample, a Healthcare Facility may be completed to the extent thatwalls, floors, and ceilings are in place. A user may utilize a virtualdisplay to understand the layout difference for different designs.Designs may be iterated from designs with the least flexibility to moreflexible (yet more complex) designs.

In some examples, the design systems may include various types offeatures such as building Healthcare Facility, walls, ducts, utilities,pipes, lighting, and electrical equipment. The design systems areaugmented with As Built Data and Experiential Data.

The design and modeling systems may be utilized to simulate and projectcost spending profiles and budgeting aspects. The modeling systems maytherefore be useful during the course of an audit, particularly whencomparing actual versus projected spending profiles. The comparison ofvarious spend sequencing may be used to optimize financing costs,maintenance, refurbishing and sequencing. The AVM 201 may be useful toprovide early estimates and for cost tracking against projections. Suchtracking may be visualized as displays across a virtual display of thebuilding, facilities and equipment.

As described above, facing a Node (e.g., a Smart Device) towards an areain a Healthcare Facility and/or moving the mobile device in a particularpattern may be used to ascertain a specific area of the HealthcareFacility for which AVM 201 data should be accessed. A combination of oneor more of: image, location, orientation, and other Sensors may also beused to identify to the mobile device specifically which wall segment,building aspect, machinery, or equipment the device is pointed towards.A location of smart device, a height, and an angle of view may also beutilized to determine aspects of the Healthcare Facility for which avirtual model is being requested.

In some embodiments, a user may be presented with various layers ofdata, including, for example, one or more of: structural aspects of theHealthcare Facility, plumbing, electrical, data runs, materialspecifications, or other documentation, including, but not limited to:basic identifying information, installation information, servicerecords, safety manuals, process records, and expected service schedule,among many other possibilities.

An additional non-limiting example, data aggregation may include Sensorsgenerating data that is associated with an IoT (Internet ofThings)-based identification. Various IoT devices (or Sensors) mayinclude a digital storage, processor, and transmitter for storing andconveying identifying information. Upon request, an IoT device may relayidentifying information of itself to a human via a communicationsdevice, or to the IoT device's neighbors. It may also possibly conveyinformation received from and/or sent to other internet connecteddevices as well.

As per the above listing, functionality may therefore include modeledand tracked Performance of a Healthcare Facility and equipment containedwithin the Healthcare Facility, including consumables 233 used andtiming of receipt and processing of consumables; modeled and actualmaintenance 232, including quality of maintenance performed; equipmentPerformance including yields; Consumables 233 tracking may include afrequency of replacement and quantity of replaced consumables; Utilities234 tracking may include projected and actually units of energyconsumed.

In one aspect of the present invention, data related to the position andidentity of substantial elements of a Healthcare Facility first asdesigned and then recorded in their actual placement and installation.This may include locations of building features, such as beams, walls,electrical junctions, plumbing and etc. as the Healthcare Facility isdesigned and constructed. As part of the Healthcare Facility model,laser scanning may be performed on site at various disparate timesduring construction. An initial scan may provide general informationrelating to the location of the Healthcare Facility in relationship toelements on the Healthcare Facility such as roadways, utilizes such aselectricity, water, gas, and sewer to identify non-limiting examples.

Additional events for scanning may occur during the construction processto capture accurate, three-dimensional As Built point-cloud information.Point cloud may include an array of points determined from image captureand/or laser scanning or other data collection technique of As Builtfeatures. In some examples, captured data may be converted into a 3Dmodel, and saved within a cloud-based data platform.

In some examples other methods of capturing spatially accurateinformation may include the use of drones and optical scanningtechniques which may include high-resolution imagery obtained frommultiple viewpoints. Scanning may be performed with light-based methodssuch as a CCD camera. Other methods may include infrared, ultraviolet,acoustic, and magnetic and electric-field mapping techniques may beutilized.

Healthcare Facility-related information may include physical featuresgenerally associated with an exterior of a Healthcare Facility such asgeolocation, elevation, surrounding trees and large landscapingfeatures, underground utility locations (such as power, water, sewer,sprinkler system, and many other possible underground utility features),paving, and pool or patio areas. Healthcare Facility-related informationmay also include features generally related to a Healthcare Facilitysuch as underground plumbing locations, stud locations, electricalconduit and wiring, vertical plumbing piping, and HVAC systems or otherduct work. The acquisition of the data may allow the model system toaccurately locate these interior and exterior features. Acquisition ofAs Built data during different points of the construction completionallows measurements to be taken prior to aspects involved in ameasurement process being concealed by concrete, drywall or othervarious building materials.

Data is acquired that is descriptive of actual physical features as thefeatures are built and converted into a 3D model which may be referredto as the “As Built” model. The As Built model will include keycomponents of the Healthcare Facility and be provided with a level ofartificial intelligence that fully describes the key component. In someembodiments, the As Built model may be compared to a design model. Insome implementations, intelligent parameters are associated with keycomponents within the 3D model. For example, key components andassociated information may further be associated with intelligentparameters. Intelligent parameters for the key components may includethe manufacturer, model number, features, options, operationalparameters, whether or not an option is installed (and if so, itsfeatures and dimensions), any hardware associated with the key component(and its manufacturer and serial number), an owner's manual, and servicecontract information, as non-limiting examples. Intelligent parametersassociated with a functional key component, such as HVAC Equipment, mayinclude the manufacturer name, model number, capacity, efficiencyrating, serial number, warranty start date, motor size, SEER rating, anowner's manual associated with the equipment, and service contractinformation.

In another aspect, the AVM system can autonomously and/or interactivelyobtain, store, and process data that is provided to it by Sensorslocated in, on or proximate to components of the Healthcare Facility, asthe Healthcare Facility is built, or when additions are made to theHealthcare Facility. The generation, modeling, capture, use, andretention of data relating to Performances in specific equipment or insome cases, aspects relating to the design of a Healthcare Facility, maybe monitored by the system.

A Healthcare Facility may be represented by a three-dimensional model,which may be integrated with information related to the key componentsand laser-scanned location information. This information may be madeavailable to the Healthcare Facility owner/Healthcare Facility builderthrough a computer, an iPad or tablet, or Smart Device. The resultingsystem may be useful to support virtual maintenance support.

The three-dimensional model may support enhancement to thetwo-dimensional views that are typical of paper-based drawings. Althoughthree-dimensional renderings are within the scope of informationdelivered in paper format, a three-dimensional electronic model mayrender dynamic views from a three-dimensional perspective. In someexamples, the viewing may be performed with viewing apparatus thatallows for a virtual reality viewing.

In some examples, a viewing apparatus, such as a smart tablet or avirtual reality headset, may include orienting features that allow auser such as a Healthcare Facility owner, Healthcare Facility builder,inspector, engineer, designer or the like to view aspects of a modelbased upon a location, a direction, a height and an angle of view. Acurrent view may be supplemented with various other information relatingto features presented in the view. In some examples, the interface maybe accessible through a virtual reality headset, computer, or mobiledevice (such as an iPad, tablet, or phone), as non-limiting examples.Utilizing a device equipped with an accelerometer, such as a virtualreality headset or mobile device, as non-limiting examples, a viewablesection of the model may be displayed through the viewing medium(whether on a screen, or through a viewing lens), where the viewer'sperspective changes as the accelerometer equipped device moves, allowingthem to change their view of the model. The viewer's Vantage Point mayalso be adjusted, through a certain user input method, or by physicalmovement of the user, as non-limiting examples.

The presented view may be supplemented with “hidden information”, whichmay include for example, depictions of features that were scanned beforewalls were installed. This hidden information may include informationabout pipes, conduits, ductwork and the like. Locations of beams,headers, studs and building Healthcare Facility may be depicted. In someexamples, depiction in a view may include a superposition of anengineering drawing with a designed location, in other examples imagesof an actual Healthcare Facility may be superimposed upon the imagebased upon As Built scans or other recordations.

In a dynamic sense, display may be used to support viewing ofhypothetical conditions such as rerouted utilities, and rebuild wallsand other such Healthcare Facility. In some examples, graphical- ortext-based data may be superimposed over an image and be used toindicate specifications, Performance aspects, or other information notrelated to location, shape and size of features in the image.

As presented above, an image may allow for a user to “see through walls”as the augmented reality viewing device simulates a section of a modelassociated with a space displayed via the virtual reality viewingdevice. The viewer's perspective may change as an accelerometer in thevirtual reality viewing device moves. A user may also change a view ofthe AVM to include different layers of data available in the AVM. Theviewer's Vantage Point may also be adjusted by moving about a physicalspace that is represented by the model. To achieve this, it may bepossible to incorporate positioning hardware directly into a buildingrepresented by the virtual model. The positioning hardware may interfacewith an augmented reality device for positioning data to accuratelydetermine the viewing device's orientation and location with millimeterprecision. The positioning hardware may include, for example, a radiotransmitter associated with a reference position and height. Altitude isdifferentiated from height unless specifically referenced since therelative height is typically more important.

Accordingly, a user may access the AVM on site and hold up a SmartDevice, such as an iPad or other tablet, and use the Smart Device togenerate a view inside a wall in front of which the Smart Device ispositioned, based upon the AVM and the location, height and direction ofthe Smart Device position.

In some examples, through the use of an augmented reality device, it mayalso be possible to view data, such as user manuals, etc. of associateddevices in the view of a user, simply by looking at them in the viewinginterface. In other examples, there may be interactive means to selectwhat information is presented on the view.

Various electronic-based devices implementing of the present inventionmay also be viewed in a virtual reality environment withoutaccelerometer such as a laptop or personal computer. A viewable sectionof a model may be displayed on a Graphical User Interface (GUI) and theviewer's Vantage Point may be adjusted, through a user input device.

The ability to track machinery and other components of a system andstore the components associated information—such as, for example, usermanuals, product specifications, and part numbers—may allow for muchmore efficient use and maintenance of the components included within aHealthcare Facility. Additionally, the system model may also maintainHealthcare Facility owner manuals and warranties and eliminate the needfor storage and tracking of hard copy manuals.

In a non-limiting example, a user may access information related to amachinery a Smart Device acting as a Node within it in proximity to themachinery and accessing the parallel model in the Virtual HealthcareFacility. This access may occur such as by clicking on the machinery inthe Virtual Healthcare Facility model or by scanning the Code labelattached to machinery. In some examples, an IoT-accessible machine mayhave the ability to pair with a user's viewing screen and allow thesystem model to look up and display various information. Thus, the usermay have access to various intelligent parameters associated with thatmachinery such as service records, a manual, service contractinformation, warranty information, consumables recommended for use suchas detergents, installation-related information, power supplyinformation, and the like.

In some examples, an AVM system may include interfaces of various kindsto components of the system. Sensors and other operationalparameter-detection apparatus may provide a routine feedback ofinformation to the model system. Therefore, by processing thedata-stream with various algorithms autonomous characterization ofoperating condition may be made. Therefore, the AVM system may provide auser with alerts when anomalies in system Performance are recognized. Insome examples, standard Healthcare Facility maintenance requirements maybe sensed or tracked based on usage and/or time and either notificationor in some cases scheduling of a service call may be made. In someexamples, the alert may be sent via text, email, or both. The HealthcareFacility user may, accordingly, log back into the Virtual HealthcareFacility to indicate completion of a maintenance task. Additionally, ifappropriate, a vendor of such service or maintenance may indicate anature and completion of work performed.

By detecting operational status, a Virtual Healthcare Facility may takeadditional autonomous steps to support optimal operation of a system. AVirtual Healthcare Facility may take steps to order and facilitateshipping of anticipated parts needed for a scheduled maintenance aheadof a scheduled date for a maintenance event (for example, shipping afilter ahead of time so the filter arrives prior to the date it isscheduled to be changed). In another example, a Virtual HealthcareFacility may recall notes from an Original Equipment Manufacturer (OEM)that could be communicated to a user through the Virtual HealthcareFacility. In still further examples, a Virtual Healthcare Facility maysupport a user involved in a real estate transaction by quantifyingservice records and Performance of a real Healthcare Facility.

Benefits derived from monitoring and tracking maintenance with a VirtualHealthcare Facility may include positively reassuring and educatinglenders and/or lien holders that their investment is being properlycared for. In addition, insurance companies may use access to a VirtualHealthcare Facility to provide factual support that their risk isproperly managed. In some examples, a data record in a VirtualHealthcare Facility model system and how an owner has cared for theirHealthcare Facility may be used by insurance companies or lenders toensure that good care is being taken. Maintenance records demonstratingdefined criteria may allow insurance companies to offer a HealthcareFacility owner policy discount. Such criteria may include, for example,installation of an alarm system. Additionally, access to a VirtualHealthcare Facility may allow municipalities and utilities to use theinformation for accurate metering of utility usage without having tomanually check a meter. In the aggregate across multiple HealthcareFacilities, peaks in utility demand may then be more accuratelyanticipated.

In some examples, a Virtual Healthcare Facility may also be used toassist with Healthcare Facility improvement projects of various types.In some examples, the Healthcare Facility improvement projects mayinclude support for building larger additions and modifications,implementing landscaping projects. Smaller projects may also beassisted, including in a non-limiting example such a project as hanginga picture, which may be made safer and easier with the 3D “as-built”point cloud information. Hidden water piping, electrical conduits,wiring, and the like may be located, or virtually “uncovered”, based onthe model database.

During construction of a Healthcare Facility corresponding to a VirtualHealthcare Facility, discrete features of the As Built HealthcareFacility may be identified via an identification device such as an IoTdevice or a QR code label. The ID device may be integrated to thefeature or added during the build scope. Performance monitors may alsobe simultaneously installed to allow monitoring of Key PerformanceIndicators (KPIs) for selected features. In an example, an HVAC systemmay be added to a Healthcare Facility during construction and asimultaneously a Performance monitor may be added to the HVAC system.The Performance monitor may be used to monitor various KPIs for an HVACsystem. These KPIs may include outdoor air temperature, discharge airtemperature, discharge air volume, electrical current, and the like.Similar monitoring capabilities may be installed to all machinery andutilities systems in a Healthcare Facility. The combination of thesenumerous system monitors may allow for a fuller picture of theefficiency of operations of various systems.

Use of the Virtual Healthcare Facility, which may include data valuescontributed from communication of data from the various monitoringsystems, may allow owners to receive periodic reports, such as in anon-limiting sense monthly emails which may show their current totalenergy consumption as well as a breakdown of what key components arecontributing to the current total energy consumption.

The systems presented herein may be used by owners and HealthcareFacility managers to make decisions that may improve the costeffectiveness of the system. An additional service for Owners may allowthe Healthcare Facility owner to tap into energy-saving options as theirHealthcare Facility ages. As an example, if a more efficient HVAC systemcomes on the market, which may include perhaps a new technology Node,the user may receive a “Savings Alert”. Such an alert may provide anestimated energy savings of the recommended modification along with anestimate of the cost of the new system. These estimates may be used togenerate a report to the owner of an estimated associatedreturn-on-investment or estimated payback period should the HealthcareFacility owner elect to replace their HVAC system.

In some examples, an AVM of a Virtual Healthcare Facility may set athreshold value for the required ROI above which they may be interestedin receiving such an alert with that ROI is achieved. This informationwill be based on data derived from actual operating conditions andactual historical usage as well as current industry information.Predictive maintenance and energy savings to key systems via SmartHealthcare Facility Total Cost of Ownership (“TCO”) branded Sensors.

With the ability to collect and utilize relevant Healthcare Facilityinformation with the model system, the aggregation of data andefficiency experience from numerous systems may allow for analysis ofoptimization schemes for various devices, machinery and other HealthcareFacility components that includes real installed location experience.Analysis from the aggregated data may be used to provide feedback toequipment manufacturers, building materials fabricators and suchsuppliers.

Referring to FIGS. 3A-3D, an illustration of the collection of data byscanning a Healthcare Facility during its construction is provided. InFIG. 3A, a depiction of a site for building a Healthcare Facility isillustrated. The depiction may represent an image that may be seen fromabove the site. Indications of Healthcare Facility boundaries such ascorners 301 and Healthcare Facility borders 302 are represented and maybe determined based on site scanning with Healthcare Facility markingsfrom site surveys or may be entered based on global coordinates for theHealthcare Facility lines. An excavated location 303 may be marked out.Roadways, parking and/or loading areas 304 may be located. Buriedutilities such as buried telephone 305, buried electric 306, buriedwater and sewer 307 are located in the model as illustrated. In someexamples, such other site service as a buried sprinkler system 308 mayalso be located.

Referring to FIG. 3B, the excavated location 303 may be scanned orimaged to determine the location of foundation elements. In somenon-limiting examples, a foundational footing 321 along with buriedutilities 322 is illustrated. The buried utilities may include utilitiessuch as electric lines, water supply (whether from a utility or a wellon-location), sewer or septic system lines, and telecommunications linessuch as telephone, cable and internet. Other footing elements 323 may belocated at structural requiring locations as they are built. In someexamples, a scanning system may provide the locational orientationrelative to site-orientation markings. In other examples, aerial imagerysuch as may be obtained with a drone may be used to convert features toaccurate location imagery.

Referring to FIG. 3C, a wall 331 of the Healthcare Facility in theprocess of build is illustrated. The Healthcare Facility may be scannedby a scanning element 330. In some examples, a laser three dimensionalScanner may be used. The wall may have supporting features like topplates 333, headers 336, studs 332, as well as internal items such aspipes 334, electrical conduits, and wires 335. There may be numerousother types of features within walls that may be scanned as they occursuch as air ducts, data cables, video cables, telephone cables, and thelike.

Referring to FIG. 3D, the wall may be completed with Healthcare Facilitycomponents behind wall facing 340 may no longer be visible. Electricaloutlets 341 and door Healthcare Facilities 342 may be scanned by ascanning element 330.

Referring to FIG. 3E, a wireless Node may be fixedly attached to aposition in or proximate to a Healthcare Facility. In some embodiments,attachment may be accomplished during construction and/or retrofittingof a structure, in which case the functionality described herein may bemade operational to track Agents, materials, equipment, and the likeduring a construction phase, and also track a location of materials andequipment included in the structure. Nodes may be installed as ReferencePoint Transceivers or be attached to items that dynamically changepositions, such as, by way of non-limiting example one or more of:Agents, building materials, structural components, electricalcomponents, plumbing components, equipment, machines and architecturalaspects (e.g. a corner, an arch, an extremity, and the like).

In some non-limiting examples of a wireless Node, a Bluetoothcommunications hub compatible with a standard such as, for exampleBLE5.1, Bluetooth Low Energy, or Wi-Fi RTT may be fixedly attached to astructural component, such as a door header 336 as Node 350 acting as aReference Point Transceiver. In another example, a Node 351 may act as aReference Point Transceiver and be attached to a wall stud,preferentially one that has electrical conduit 335 running along it. Insome embodiments, the electrical conduit 335 may supply power to theNode 351. Alternatively, a Node 352 may be configured as part of areceptacle box. In some examples, one or more Nodes 350-351 may bebattery powered. One or more Nodes 350-351 may be powered via electricalsupply wiring 353 from a nearby power conduit 335 so that the Node350-351 may be tied into a centrally powered electrical system.Moreover, the Nodes may be adapted to de-power and de-couple from anetwork based on a power supply status or a power drain change.

FIG. 3F illustrates an exemplary Agent 365 supporting a Smart Device 366with wireless communications components enabling RF communications suchas, one or more of: Cellular, Wi-Fi, Bluetooth, Zigbee, and otherwireless capabilities. The Smart Device 366 may also include devicescapable of receiving and/or transmitting with infrared capabilities. TheSmart Device 366 may also include, or be in logical communication with,transducers capable of emitting sound, and in some examples, infrasoundand/or ultrasonic sound, as well as microphones capable of detectingultrasonic sound and/or infrasound. An Agent 365 may become positionedproximate to a door Healthcare Facility 342 such that the Agent 365supported Smart Device 366 may wirelessly communicate with a Node 362fixedly attached to the Healthcare Facility 342. The Node 362 may be inelectrical communication with one or more of: a set of protrudingantennas 360, an antenna array device 361 (which may include a multitudeof antennas separated at distances efficient for communication and/orlocation determination). A wireless Node with antennas 362 may belocated proximate to a typical wall outlet Healthcare Facility. Any ofthese Nodes 360-362 may communicate with the Smart device for locationprotocols such as RSSI, Time of Flight, and Angle of Arrival asnon-limiting examples. The Nodes 360-362 may have a carefully measureddistance characterization for each of the antennas that they employ andone of the antennas involved in wireless communication may be furthercharacterized as being a local or global origin point (0,0,0 inCartesian notation). In other examples, none of the antenna locationsmay be located at a local or global origin point, but rather a knownoffset from a specified origin point 370 may be characterized for eachof the hub antenna locations.

The Agent 365 may proceed through a threshold of the door HealthcareFacility 342 and be located on the other side. Nodes 360-362 may eachprotrude from both sides of a wall and/or may have a second set ofantennas located on a distal side of the wall. In other examples,materials used in wall construction may be configured to provide minimalinterference with wireless signals travelling through the wallmaterials. For configurations with a second set of antennas, as the userpasses through the door, a communication between the Smart Device 366and the Node 360-362 may transfer from antennas protruding on aproximate wall side to antennas protruding on a distal wall side.

A geographic position of a Healthcare Facility may be calculated viawireless communications, such as those using sub-GHz wavelengths, GPS,or other longer range wavelength a Smart Device from within theHealthcare Facility. The geographic position may be used to indicate aHealthcare Facility identification. A position within the HealthcareFacility may be determined based upon one or more of: an angle ofarrival and angle of departure of a wireless signal and one or moretiming signals used to determine a distance of the Smart Device from: a)a Node acting as Reference Point Transceiver; or b) a dynamic positionNode.

In some embodiments, an angle of departure or an angle of arrival arenot necessary and a position may be determined by measuring a distanceto three or more positioning reference devices. However, in someembodiments, it may still be useful to compute an angle between thepositioning reference devices and/or the Node.

Additional aspects that may be referenced to determine a location of aNode or Smart Device accurately may include one or more of: relativesignal strength received from wireless transmissions emanating fromanother Nodes; time of arrival of radio signals of wirelesstransmissions emanating from another Node; generating a distance toanother Node based upon a time difference of arrival of radio signals ofwireless transmissions emanating from another Node; or an angle ofarrival and/or angle of departure of a wireless transmission fromanother Node.

The above steps may be repeated for multiple Nodes of various types,including both reference point transceiver Nodes and dynamic positionNodes.

As mentioned above, in some embodiments, wireless communications mayinclude a quantification of a condition within or proximate to aHealthcare Facility. The condition may include, for example, one or moreof: a vibration measured with an accelerometer; a temperature of atleast a portion of the Healthcare Facility; an electrical currentmeasurement to equipment installed in the Healthcare Facility, a numberof cycles of operation of equipment installed in the HealthcareFacility; a number of cycles of operation of an machinery installed inthe Healthcare Facility; an electrical current measurement to anelectrical device located within the Healthcare Facility; a vibration orother sensor measurement associated with movement of an Agent or personwithin the Healthcare Facility; or presence of water and/or humiditywithin the Healthcare Facility.

A vibration pattern may be associated with a specific occupant, andtracking the movement of the specific occupant through the HealthcareFacility may be based upon measured vibration patterns. Similarly, avibration pattern may be associated with a particular activity of aspecific occupant and the activity of the specific occupant may betracked within the Healthcare Facility based upon measured vibrationpatterns.

Referring now to FIG. 4, according to the present invention, an Agent400 may support a Node with one or more Transceivers. The Transceiversmay include one or more of: a Multi-modality Transceiver 401;Transceivers having a same modality 402; Transceivers of differentmodalities 403; transmitters of a single modality 404; transmitters ofmultiple modalities 405; receivers of a single modality 406; andreceivers of multiple modalities 407. Similarly, a Node deployed as aReference Point Transceiver may include multiple Transceivers,transmitters, and receivers 401-408. The multiple Transceivers,transmitters, and receivers 401-408 may include one or both of:transmitters and receivers of a same modality; and transmitters andreceivers of different modalities.

A modality, as used in conjunction with a Transceiver, transmitter,and/or receiver refers to one or both of a bandwidth of wirelesscommunication and a protocol associated with a bandwidth. By way ofnon-limiting example, a modality, as used in relation to a Transceiver,transmitter, and/or receiver may include: Wi-Fi; Wi-Fi RTT; Bluetooth;UWB; Ultrasonic; sonic; infrared; or other logical communication medium.

FIG. 5 illustrates Nodes with Reference Point Transceivers 501-504 thatmay be deployed in a defined area 506, such as a Healthcare Facility todetermine a location 507 of an Agent 500 supporting a Node 505. Nodeswith Reference Point Transceivers 501-504 may be fixed in a location andwirelessly communicate in a manner suitable for determination a positionof the Node Transceiver 505 supported by the Agent 500. Transceiving maybe via wireless transmission using one or more bandwidths andcommunication protocols by a Node Transceiver 505 supported by the Agent500.

By way of non-limiting example, Node Transceivers 505 supported by theAgent 500 may be included in, or be in logical communication with, aSmart Device, such as a smart phone, tablet or other Agent-supportabledevice, such as a headgear, ring, watch, wand, pointer with NodeTransceivers 505 able to Transceive with the Reference PointTransceivers 501-504. The Reference Point Transceivers 501-504 mayinclude devices, such as, for example, a radio transmitter, radioreceiver, a light generator, or an image recognizable device. A radiotransmitter may include a router or other Wi-Fi, Bluetooth or othercommunication device for entering into logical communication with acontroller. In some embodiments, Reference Point Transceivers 501-504may include a Wi-Fi router that additionally provides access to adistributed network, such as the Internet. Cartesian Coordinates, PolarCoordinates, Vector values, a GPS position, or other data that may beutilized for one or more of: locating one or both of an Agent 500;indicating a direction of interest; and identifying a HealthcareFacility or defined area 506.

A precise location may be determined based upon wireless transmissionsbetween Nodes. Timing determinations—as well as angle of arrival, angleof departure, transmission strength, transmission noise, andtransmission interruptions—may be considered in generating relativepositions of Nodes. Additional considerations may include AI andunstructured queries of transmissions between Nodes and triangulationlogic based upon a measured distance from three or more Reference PointNodes 501-504. For example, a radio transmission or light emission maybe measured and timing associated with the radio transmission or lightto determine a distance between Nodes. Distances from three referenceposition identifiers 501-503 may be used to generate a position of aNode in consideration. Other methodologies include determination of adistance from one or more Nodes and a respective angle of arrival and/orangle of departure of a radio or light transmission between the Node inconsideration and another Node (Reference Point Node or dynamic positionNode).

Other embodiments may include a device recognizable via image analysisand a camera or other Image Capture Device, such as a CCD device, maycapture an image of three or more Reference Point Nodes 501-504. Imageanalysis may recognize the identification of each of three or more ofthe Reference Point Transceivers 501-504 and a size ratio of therespective image captured Reference Point Transceivers 501-504 may beutilized to calculate a precise position. Similarly, a heightdesignation may be made via triangulation using the position identifiersas reference to a known height or a reference height.

Triangulation essentially includes determining an intersection of threedistances 508-510, each distance 508-510 calculated from a referencepoint 501-504 to an Agent-supported device 505. The present inventionallows for a first distance 508 to be determined based upon a wirelesscommunication in a first modality; and a second distance 509 and a thirddistance 510 determined based upon a wireless communication in a same ordifferent modality as the first modality. For example, a first distance508 may be determined based upon a wireless communication using Wi-Fi; asecond distance 509 may be determined based upon a wirelesscommunication using Bluetooth; and a third communication may bedetermined based upon a wireless communication using ultrasoniccommunication (other combinations of same and/or different communicationmodalities are also within the scope of the present invention).

Referring now to FIG. 6, an automated controller is illustrated that maybe used to implement various aspects of the present invention in variousembodiments, and for various aspects of the present invention.Controller 600 may be included in one or more of: a wireless tablet orhandheld smart device, a server, an integrated circuit incorporated intoa Node, appliance, equipment item, machinery or other automation. Thecontroller 600 includes a processor unit 602, such as one or moresemiconductor based processors, coupled to a communication device 601configured to communicate via a communication network (not shown in FIG.6). The communication device 601 may be used to communicate, forexample, with one or more online devices, such as a smart device, aNode, personal computer, laptop, or a handheld device.

The processor 602 is also in communication with a storage device 603.The storage device 603 may comprise any appropriate information storagedevice, including combinations of digital storage devices (e.g. an SSD),optical storage devices, and/or semiconductor memory devices such asRandom Access Memory (RAM) devices and Read Only Memory (ROM) devices.

The storage device 603 can store a software program 604 with executablelogic for controlling the processor 602. The processor 602 performsinstructions of the software program 604, and thereby operates inaccordance with the present invention. The processor 602 may also causethe communication device 601 to transmit information, including, in someinstances, timing transmissions, digital data and control commands tooperate apparatus to implement the processes described above. Thestorage device 603 can additionally store related data in a database 605and database 606, as needed.

Referring now to FIG. 6A, an illustration of an exemplary wireless Node610 configured with a transceiver 624 to wirelessly communicate via oneor more wireless communication Modalities, including a bandwidth andprotocol, such as the Bluetooth 5.1; BLE5.1; Wi-Fi RT and/or GPSstandard is illustrated. As discussed, many different Modalities ofwireless technology may be utilized with the content presented herein,but a BLE5.1 “radio” module is an interesting example since itsstandards provide for angle of arrival (AoA) capability as well as angleof departure (AoD) and a distance determination based upon a timingsignal. With AoA/AoD a designed antenna array 625 can be used by an RFTransceiver 624 to measure a phase shift amongst multiple antennaelements to estimate distance differences between the antennas and toextract an angle from the antenna array to the source of radiation. ABLE5.1-consistent multichip transceiver 624 may include circuitry andsoftware code to perform the acquisition of data and determine the angleof arrival in some examples. In other examples, a BLE5.1-consistentmultichip transceiver 624 may control the acquisition of data from anantenna array while streaming the data to off module processingcapabilities. The BLE5.1-consistent Node 610 may contain functionalblocks of circuitry for peripheral 620 control. The peripherals mayinclude a connection to external host controllers/MCUs 621. Theperipheral 620 control may also interact with peripheral and IoT Sensorsand other devices 622.

The BLE5.1-consistent Node 610 may include a processing element 623which may have its own memory of different types as well as capabilitiesfor encryption of data. The BLE5.1 consistent Node 610 may also haveTransceiver 624. This circuitry may include Baseband and RF functions aswell as control the AoA functions and the self-verifying arrayfunctions. The Bluetooth communications 624 may receive signals throughan on-module antenna 625 or an external antenna or array of antennas mayprovide external RF input 626. The BLE5.1-consistent Node 610 mayinclude functional circuitry blocks for control of Security functions627, cryptogenerations, random number generation and the like. TheBLE5.1-consistent Node 610 may include functional blocks for powermanagement 628.

The BLE5.1-consistent Node 610 may be operative for quantification oftemperature aspects of the Node 610, battery-control functions andpower-conversion functions. An external power source 633 may be includedto provide electrical energy to a power management unit 628 which, insome examples. may be from a battery unit, or a grid connected powersupply source in other examples. The BLE5.1-consistent Node 610 mayinclude functions for control of timing and triggering 629. In a relatedsense, the BLE5.1-consistent Node 610 may include functions for clockmanagement 630 within the module. The BLE5.1-consistent Node 610 mayalso include circuit elements that are always-on 631 to allow externalconnections 632 to interact with the device and perhaps awake it from adormant state. There may also be other customized and/or genericfunctions that are included in a BLE5.1-consistent Node 610 and/ormultichip module.

Referring now to FIG. 6B, a Node 610 included in a higher orderdeployment assembly is illustrated. A deployment Node 650 may be inlogical communication with one or more of: sensors, customized controlcommands, antenna array designs and the like.

A Node 650 may include multiple antennas or antenna arrays 651-656. Asdescribed previously, the Node 650 may include a transceiver module 610,and in some examples, the transceiver module may includeBluetooth-adherent aspects. Communications received via an antenna651-656 may be directly ported into the transceiver module 610.Embodiments may also include routing particular antenna/antenna arrayoutputs to the transceiver module 610 in a controlled and timedsequence. A processing Module 670 may coordinate a connection of theNode 650 to external peripherals.

In some examples, circuitry 680 to logically communicate with one ormore of: a Peripheral, a data Connection, Cameras and Sensorscontrollers, and components to perform data and image acquisition ofvarious kinds, or it may interface external components with the Node650.

The Node 650 may also include its own power management unit 660 whichmay take connected power or battery power or both and use it to provethe various power needs of the components of the assembly. The Node 650may have its own processing modules 670 or collections of differenttypes of processing functions which may have dedicated memory components671. In some examples, specialized processing chips of various kindssuch as Graphical Processing Units and fast mathematics functioncalculators as well as dedicated artificial intelligence processingchips may be included to allow the Node 650 to perform variouscomputational functions including location determination of wirelesslyconnected devices amongst other functions. There may be numerous otherfunctions to include in a Node 650 and alternatives types of devices toperform the functions presented herein.

In some examples as illustrated in FIG. 6C antenna arrays 690, 691 maybe assembled into a “Puck” shown as Node 650 wherein the antenna arraysare configured with antenna designs which have directional aspects tothem. Directional aspects may mean that the antennas may be sensitive toincident radiation coming from a certain direction but not sensitive toradiation coming from a different direction. Antenna arrays 690, 691 mayinclude antennas that may have maximized signals for a particularincident waveform, the identification of which antenna may provide orsupplement angle of incidence calculations.

A directional antenna may include, for example, an antenna with RFshielding over some portion of an antenna's circumference. For example,270° (or some other subset of a 360° circumference of an antenna), or anantenna array may have RF shielding to block and/or reflect back an RFsignal towards the antenna-receiving portion. Other directional antennasmay include a shield blocking less than 360° of RF transmissions thatrotates around a receiving portion of an antenna and only receives RFcommunications from a direction of an opening in the shield. Shieldedantennas may provide improved determination of a direction from which awireless transmission is being received from, since RF noise is blockedfrom a significant portion of a reception sphere.

Referring now to FIG. 7, a block diagram of an exemplary mobile device702 is illustrated. The mobile device 702 comprises an optical capturedevice 708 to capture an image and convert it to machine-compatibledata, and an optical path 706, typically a lens, an aperture or an imageconduit to convey the image from the rendered document to the opticalcapture device 708. The optical capture device 708 may incorporate aCCD, a Complementary Metal Oxide Semiconductor (CMOS) imaging device, oran optical Sensor 724 of another type.

A microphone 710 and associated circuitry may convert the sound of theenvironment, including spoken words, into machine-compatible signals.Input facilities may exist in the form of buttons, scroll wheels, orother tactile Sensors such as touch-pads. In some embodiments, inputfacilities may include a touchscreen display.

Visual feedback to the user is possible through a visual display,touchscreen display, or indicator lights. Audible feedback 734 may comefrom a loudspeaker or other audio transducer. Tactile feedback may comefrom a vibrate module 736.

A motion Sensor 738 and associated circuitry convert the motion of themobile device 702 into machine-compatible signals. The motion Sensor 738may comprise an accelerometer that may be used to sense measurablephysical acceleration, orientation, vibration, and other movements. Insome embodiments, motion Sensor 738 may include a gyroscope or otherdevice to sense different motions.

A location Sensor 740 and associated circuitry may be used to determinethe location of the device. The location Sensor 740 may detect GlobalPosition System (GPS) radio signals from satellites or may also useassisted GPS where the mobile device may use a cellular network todecrease the time necessary to determine location. In some embodiments,the location Sensor 740 may use radio waves to determine the distancefrom known radio sources such as cellular towers to determine thelocation of the mobile device 702. In some embodiments these radiosignals may be used in addition to GPS.

The mobile device 702 comprises logic 726 to interact with the variousother components, possibly processing the received signals intodifferent formats and/or interpretations. Logic 726 may be operable toread and write data and program instructions stored in associatedstorage or memory 730 such as RAM, ROM, flash, or other suitable memory.It may read a time signal from the clock unit 728. In some embodiments,the mobile device 702 may have an on-board power supply 732. In otherembodiments, the mobile device 702 may be powered from a tetheredconnection to another device, such as a Universal Serial Bus (USB)connection.

The mobile device 702 also includes a network interface 716 tocommunicate data to a network and/or an associated computing device.Network interface 716 may provide two-way data communication. Forexample, network interface 716 may operate according to the internetprotocol. As another example, network interface 716 may be a local areanetwork (LAN) card allowing a data communication connection to acompatible LAN. As another example, network interface 716 may be acellular antenna and associated circuitry which may allow the mobiledevice to communicate over standard wireless data communicationnetworks. In some implementations, network interface 716 may include aUniversal Serial Bus (USB) to supply power or transmit data. In someembodiments other wireless links may also be implemented.

As an example of one use of mobile device 702, a reader may scan somecoded information from a location marker in a Healthcare Facility withthe mobile device 702. The coded information may be included onapparatus such as a hash code, bar code, RFID or other data storagedevice. In some embodiments, the scan may include a bit-mapped image viathe optical capture device 708. Logic 726 causes the bit-mapped image tobe stored in memory 730 with an associated time-stamp read from theclock unit 728. Logic 726 may also perform optical character recognition(OCR) or other post-scan processing on the bit-mapped image to convertit to text. Logic 726 may optionally extract a signature from the image,for example by performing a convolution-like process to locate repeatingoccurrences of characters, symbols or objects, and determine thedistance or number of other characters, symbols, or objects betweenthese repeated elements. The reader may then upload the bit-mapped image(or text or other signature, if post-scan processing has been performedby logic 726) to an associated computer via network interface 716.

As an example of another use of mobile device 702, a reader may capturesome text from an article as an audio file by using microphone 710 as anacoustic capture port. Logic 726 causes audio file to be stored inmemory 730. Logic 726 may also perform voice recognition or otherpost-scan processing on the audio file to convert it to text. As above,the reader may then upload the audio file (or text produced by post-scanprocessing performed by logic 726) to an associated computer via networkinterface 716.

A directional Sensor 741 may also be incorporated into the mobile device702. The directional Sensor may be a compass and produce data based upona magnetic reading or based upon network settings. A direction al sensormay also include a light source and receptor, such as an infrareddistance device. The infrared distance device may be used to providehighly accurate distance determination from a selected surface.

Referring now to FIG. 8, additional apparatus and methods fordetermining a geospatial location and determination of a direction ofinterest may include one or both of an enhanced Smart Device and a SmartDevice in logical communication with wireless position devices 803-810.The importance of geospatial location and determination of a directionof interest is discussed in considerable detail above. As illustrated, aSmart Device 801 may be in logical communication with one or morewireless position devices 803-810 strategically located in relation tothe physical dimensions of the Smart Device. For example, the SmartDevice 801 may include a smart phone or tablet device with a userinterface surface 820 that is generally planar. The user interfacesurface 820 will include a forward edge 818 and a trailing edge 819.

In some preferred embodiments, the Smart Device will be fixedly attachedto a smart receptacle 802. The smart receptacle 802 may include anappearance of a passive case, such as the type typically used to protectthe Smart Device 801 from a damaging impact. However, according to thepresent invention, the smart receptacle 802 will include digital and/oranalog logical components, such as wireless position devices 803-810.The wireless position devices 803-810 include circuitry capable ofreceiving wireless transmissions from multiple wireless positionalreference Transceivers 811-814. The wireless transmissions will includeone or both of analog and digital data suitable for calculating adistance from each respective reference point 811-814.

In some embodiments, the smart receptacle 802 will include a connector815 for creating an electrical path for carrying one or both ofelectrical power and logic signals between the Smart Device 801 and thesmart receptacle 802. For example, the connector 815 may include amini-USB connector or a lightening connector. Additional embodiments mayinclude an inductive coil arrangement for transferring power.

Embodiments may also include wireless transmitters and receivers toprovide logical communication between the wireless position devices803-810 and the Smart Device 801. Logical communication may beaccomplished, for example, via one or more of: Bluetooth, ANT, andinfrared media.

Reference Transceivers 811-814 provide wireless transmissions of datathat may be received by wireless position devices 803-810. The wirelesstransmissions are utilized to generate a position of the respectivewireless position devices 803-810 in relation to the referenceTransceivers 811-814 providing the wireless transmissions to thewireless position devices 803-810. The wireless position devices 803-810are associated with one or more of: a position in a virtual model; ageographic position; a geospatial position in a defined area, such asHealthcare Facility; and a geospatial position within a defined area(such as, for example a Healthcare Facility).

According to the present invention, a Smart Device may be placed into acase, such as a smart receptacle 802 that includes two or more wirelessposition devices 803-810. The wireless position devices 803-810 mayinclude, for example, one or both of: a receiver and a transmitter, inlogical communication with an antenna configured to communicate withreference Transceivers 811-814. Communications relevant to locationdetermination may include, for example, one or more of: timing signals;SIM information; received signal strength; GPS data; raw radiomeasurements; Cell-ID; round trip time of a signal; phase; and angle ofreceived/transmitted signal; time of arrival of a signal; a timedifference of arrival; and other data useful in determining a location.

The Nodes 803-810 may be located strategically in the case 802 toprovide intuitive direction to a user holding the case 802, and also toprovide a most accurate determination of direction. Accordingly, aforward Node 803 may be placed at a top of a Smart Device case and arearward Node 804 may be placed at a bottom of a Smart Device case 802.Some embodiments each of four corners of a case may include a Node 805,806, 807, 808. Still other embodiments may include a Node 809 and 810 oneach lateral side.

The present invention provides for determination of a location of two ormore wireless positioning devices 803-810 and generation of one or moredirectional Vectors 817 and/or Rays based upon the relative position ofthe wireless positioning devices 803-810. For the sake of convenience inthis specification, discussion of a Vector that does not includespecific limitations as to a length of the Vector and is primarilyconcerned with a direction, a Ray of unlimited length may also beutilized. In some embodiments, multiple directional Vectors 817 aregenerated and a direction of one or more edges, such as a forward edge,is determined based upon the multiple directional Vectors 817.

According to the present invention, a geospatial location relative toone or more known reference points is generated. The geospatial locationin space may be referred to as having an X,Y position indicating aplanar designation (e.g. a position on a flat floor), and a Z position(e.g. a level within a Healthcare Facility, such as a second floor) maybe generated based upon indicators of distance from reference points.Indicators of distance may include a comparison of timing signalsreceived from wireless references. A geospatial location may begenerated relative to the reference points. In some embodiments, ageospatial location with reference to a larger geographic area isassociated with the reference points, however, in many embodiments, thecontroller will generate a geospatial location relative to the referencepoint(s) and it is not relevant where the position is located inrelation to a greater geospatial area.

In some embodiments, a position of a Smart Device may be ascertained viaone or more of: triangulation; trilateration; and multilateration (MLT)techniques.

A geospatial location based upon triangulation may be generated basedupon a controller receiving a measurement of angles between the positionand known points at either end of a fixed baseline. A point of ageospatial location may be determined based upon generation of atriangle with one known side and two known angles.

A geospatial location based upon trilateration may be generated basedupon a controller receiving wireless indicators of distance and geometryof geometric shapes, such as circles, spheres, triangles and the like.

A geospatial location based upon multilateration may be generated basedon a controller receiving a measurement of a difference in distance totwo reference positions, each reference position being associated with aknown location. Wireless signals may be available at one or more of:periodically, within determined timespans, and continually. Thedetermination of the difference in distance between two referencepositions provides multiple potential locations at the determineddistance. A controller may be used to generate a plot of potentiallocations. In some embodiments, the potential determinations generallyform a curve. Specific embodiments will generate a hyperbolic curve.

The controller may be programmed to execute code to locate an exactposition along a generated curve, which is used to generate a geospatiallocation. The multilateration thereby receives as input multiplemeasurements of distance to reference points, wherein a secondmeasurement taken to a second set of stations (which may include onestation of a first set of stations) is used to generate a second curve.A point of intersection of the first curve and the second curve is usedto indicate a specific location.

In combination with, or in place of directional movement of a SmartDevice 801 in order to quantify a direction of interest to a user, someembodiments may include an electronic and/or magnetic DirectionalIndicator that may be aligned by a user in a direction of interest.Alignment may include, for example, pointing a specified side of adevice, or pointing an arrow or other symbol displayed upon a userinterface on the device towards a direction of interest.

In a similar fashion, triangulation may be utilized to determine arelative elevation of the Smart Device as compared to a referenceelevation of the reference points.

It should be noted that although a Smart Device is generally operated bya human user, some embodiments of the present invention include acontroller, accelerometer, and data storage medium, Image CaptureDevice, such as a Charge Coupled Device (“CCD”) capture device and/or aninfrared capture device being available in a handheld or unmannedvehicle or other Agent.

An unmanned vehicle may include for example, an unmanned aerial vehicle(“UAV”) or an unmanned ground vehicle (“UGV”), such as a unit withwheels or tracks for mobility. A radio control unit may be used totransmit control signals to a UAV and/or a UGV. A radio control unit mayalso receive wireless communications from the unmanned vehicle.

In some embodiments, multiple unmanned vehicles may capture data in asynchronized fashion to add depth to the image capture and/or a threedimensional and 4 dimensional (over time) aspect to the captured data.In some implementations, a UAV position will be contained within aperimeter and the perimeter will have multiple reference points to helpeach UAV (or other unmanned vehicle) determine a position in relation tostatic features of a building within which it is operating and also inrelation to other unmanned vehicles. Still other aspects includeunmanned vehicles that may not only capture data but also function toperform a task, such as paint a wall, drill a hole, cut along a definedpath, or other function. As stated throughout this disclosure, thecaptured data may be incorporated into an AVM.

In still other embodiments, captured data may be compared to a libraryof stored data using recognition software to ascertain and/or affirm aspecific location, elevation, and direction of an image capture locationand proper alignment with the virtual model. Still other aspects mayinclude the use of a compass incorporated into a Smart Device.

By way of non-limiting example, functions of the methods and apparatuspresented herein may include one or more of the following factors thatmay be modeled and/or tracked over a defined period of time, such as,for example, an expected life of a build (such as 10 years or 20 years).

Referring now to FIG. 8A, in some embodiments, Nodes 803A-810A may beincorporated into a Smart Device 801A and not require a smart receptacleto house Nodes 803-810. Nodes 803A-810A that are incorporated into aSmart Device, such as a smart phone or smart tablet, will includeinternal power and logic connections and therefore not require wirelesscommunication between the controller in the Smart Device 801A and theNodes 803A-810A.

A Smart Device 801A with integrated Nodes 803-810 and a Smart Device 801with Nodes 803-810 in a smart receptacle 802 may provide a directionalindication, such as a directional Vector 817 817A, without needing tomove the Smart Device from a first position to a second position since adirectional Vector may be determined from a relative position of a firstNodes 803-810 and a second wireless positional device Nodes 803-810.

In exemplary embodiments, as described herein, the distances may betriangulated based on measurements of Wi-Fi strength at two points.Wi-Fi signal propagates outward as a wave, ideally according to aninverse square law. Ultimately, a feature of the present inventionrelies on measuring relative distances at two points. In view of thespeed of Wi-Fi waves and the real-time computations involved inorienteering; these computations may be as computationally simple aspossible. Thus, depending upon a specific application and mechanism forquantifying a condition, such as a measurement, various coordinatesystems may be desirable. In particular, if the Smart Device moves onlyin a planar direction while the elevation is constant, or only at anangle relative to the ground, the computation is more simple.

One exemplary coordinate system includes a polar coordinate system. Oneexample of a three-dimensional polar coordinate system is a sphericalcoordinate system. A spherical coordinate system typically comprisesthree coordinates: a radial coordinate, a polar angle, and an azimuthalangle (r, θ, and φ, respectively, though θ and φ are occasionallyswapped conventionally).

By way of non-limiting example, suppose Point 1 is considered the originfor a spherical coordinate system (i.e., the point (0, 0, 0)). EachWi-Fi emitter e1, e2, e3 can be described as points (r1, θ1, φ1), (r2,θ2, φ2), and (r3, θ3, φ3), respectively. Each of the r_(i)'s (1≤i≤3)represent the distance between the Wi-Fi emitter and the Wi-Fi receiveron the Smart Device.

It is understood that in some embodiments, an azimuth may include anangle, such as a horizontal angle determined in an arcuate manner from areference plane or other base direction line, such as an angle formedbetween a reference point or reference direction; and line (Ray orVector) such as a Ray or Vector generated from or continuing to; a SmartDevice, or a positional Sensor in logical communication with a SmartDevice or other controller. In preferred embodiments the Ray or Vectormay be generally directed from a reference point Transceiver towards,and/or intersect one or more of: an item of interest; a point ofinterest; an architectural aspect (such as a wall, beam, header, corner,arch, doorway, window, etc.); an installed component that may act as areference in an AVM (such as for example, an electrical outlet, a lightfixture, a plumbing fixture, an architectural aspect; an item ofequipment; an appliance; a multimedia device, etc.); another referencepoint Transceiver or other identifiable destination. Embodiments includea position of the Transceiver being determined via use of a polarcoordinate system. The polar coordinate system may include a sphericalcoordinate system or a cylindrical coordinate system.

Accordingly, in some embodiments, spherical coordinate system mayinclude reference point Transceiver that is capable of determining anangle of departure of a location signal and a Transceiver that iscapable of determining an angle of arrival of the location signal; oneor both of which may be used to facilitate determination of anapplicable azimuth.

According to various embodiments of the present invention, one or bothof an angle of departure and an angle of arrival may therefore beregistered by a Transceiver that is transmitting and/or receivingwireless signals (e.g. radio frequency, Bluetooth 5.1, sonic frequency,or light frequency).

In some embodiments, orienteering occurs in a Healthcare Facility, inwhich Transceivers, (including, for example, one or more of: Wi-FiTransceivers, UWB Transceivers, Bluetooth Transceivers, infraredTransceivers and ultrasonic Transceivers) may be located above and/orbelow an Agent. In these embodiments, a cylindrical coordinate systemmay be more appropriate. A cylindrical coordinate system typicallycomprises three coordinates: a radial coordinate, an angular coordinate,and an elevation (r, θ, and z, respectively). A cylindrical coordinatesystem may be desirable where, for example, all Wi-Fi emitters have thesame elevation.

Referring now to FIG. 8B, in some embodiments, one or both of a SmartDevice 801 and a smart receptacle 802 may be rotated in a manner (suchas, for example in a clockwise or counterclockwise movement 820,822relative to a display screen) that repositions one or more Nodes 803-810from a first position to a second position. A Vector 826 may begenerated at an angle that is perpendicular 825 or some other designatedangle in relation to the Smart Device 801. In some embodiments, an anglein relation to the Smart Device is perpendicular 825 and therebyviewable via a forward looking camera on the Smart Device.

A user may position the Smart Device 801 such that an object in adirection of interest is within in the camera view. The Smart Device maythen be moved to reposition one or more of the Nodes 803-810 from afirst position to a second position and thereby capture the direction ofinterest via a generation of a Vector in the direction of interest.

Referring now to FIG. 8C, as illustrated, a Vector 825 indicative of adirection of interest may be based upon a rocking motion 823-824 of theSmart Device 801, such as a movement of an upper edge 818 in a forwardarcuate movement 823. The lower edge 819 may also be moved in acomplementary arcuate movement 824 or remain stationary. The movement ofone or both the upper edge 818-819 also results in movement of one ormore Nodes 803-810. The movement of the Nodes 803-810 will be asufficient distance to register to geospatial positions based uponwireless transmissions. A required distance will be contingent upon atype of wireless transmission referenced to calculate the movement. Forexample, an infrared beam may require less distance than a Wi-Fi signal,and a Wi-Fi transmission may require less distance than a cell towertransmission which in turn may require less distance than a GPS signal.In some embodiments, as discussed further below, hybrid triangulationmay include one or more distances based upon wireless transmissions ofdifferent bandwidths or modalities. For example, a first modality mayinclude Wi-Fi transmissions and a second modality may include Bluetoothtransmissions, still another modality may include infrared or ultrasonicmodalities.

Referring to FIG. 8D, line segments 831-838 are illustrated thatintersect various generated position points (PP1-PP8) for Transceivers803-810. Position points PP1-PP8 may be generated according to themethods and apparatus presented herein, including a mathematicalaverage, median, weighted average, or other calculation of multiplepositions determined via triangulation techniques. In addition, a Vector839 or Ray may be generated based upon one or more of the lines 831-838.In some embodiments, position points may be recorded in high numbersbased upon thousands of logical communications per second and a virtualrepresentation of the position points PP1-PP8 may be generated basedupon the recorded position points PP1-PP8. Some embodiments may alsoinclude a cloud point type representation a device that comprises theTransceivers used to record position point PP1-PP8, wherein the cloudpoint representation is based upon the multiple positions calculated.

Directional Wireless Modalities

Some modalities, such as those modalities that adhere to the Bluetooth5.1 or BL5.1 standards, allow a Node to determine an angle of arrival(AoA) or an angle of departure (AoD) for a wireless transmission. Anarray of antennas may be used to measure aspects of the Bluetoothsignaling that may be useful to calculate these AoA and AoD parameters.By calibrating an antenna system, the system may be used to determineangles in one or two dimensions depending on the design of the antenna.The result may be significant improvement in pinpointing the location oforigin of a signal.

An array of antennas may be positioned relative to each other and atransmitting transceiver to allow for extraction of an AoA/AoD. Such anarray may include a rectangular array; a polar or circular array; alinear array; and a patterned array, where a number of antennas aredeployed in a pattern conducive to a particular environment fortransceiving. Antennas may be separated by characterized distances fromeach other, and in some examples, a training protocol for the antennaarray results in antenna positioning incorporating superior angle andlocation precision. Some Nodes may transceive in 2.4-2.482 GHz frequencybands, and thus the RF transmissions may have wavelengths in the roughly125 mm length scale. A collection of antennas separated by significantlyless than the wavelength may function by comparing a phase of RFtransmissions arriving at the antennas. An accurate extraction of phasedifferences can yield a difference in path length that when accumulatedcan lead to a solution for the angles involved.

Referring to FIGS. 9A-D a series of exemplary devices employing matricesof antennas for use with Nodes that communicate via a Bluetoothstandard, a Wi-Fi standard or other modality, is illustrated. Linearantenna arrays 910 are illustrated in FIG. 9A. Rectangular antennaarrays 920 are illustrated in FIG. 9B. Rectangular antenna arrays 930are illustrated in FIG. 9C.

Nodes may include antenna arrays combined with batteries and circuitryto form complete self-contained devices. The Nodes or a controller maydetermine an AoA and/or AoD or other related angular determinationsbased upon values for variables involved in wireless communications. Inan example, a composite device 940 may be formed when a Node 942 with acircular configuration of antenna elements 943 is attached to anexemplary Smart Device 941. The Node 942 attached to the Smart Device941 may communicate information from and to the Smart Device 941including calculated results received from or about another Node, suchas a Node fixed as a Reference Point Transceiver or a Node with dynamiclocations, wherein the wireless communications are conducive togeneration of reference angles of transmission and/or receiving.

Referring to FIG. 10A, a Smart Device 1020 may be equipped with a Node1030 that includes a self-contained Bluetooth 5.1 antenna matrix. In theexample, the matrix of antennas in the Node 1030 may be configured in acircular pattern. Electronics in the device may capture communicationsignals sent from a wireless access point 1010. Each of the paths fromthe wireless access point to the various antennas of the Node 1030 has aslightly different path through air from the wireless access point 1010to the Smart Device. This may give each of the signals a slightlydifferent phase alignment with each other. The electronics of the Node1030 may include both hardware and software along, with training historyof the antenna array for the device and may be able to use the differentphase measurements and training history to determine both an azimuthalangle 1040 and altitude angle 1050 as an example. The resultingdirection pinpoints a significantly improved understanding of thelocation of the Smart Device 1020. In some examples, the calculatedresult may localize the Smart Device 1020 relative to the wirelessaccess point with an accuracy better than 50 cm. In desirable noise andsignal situations, a relative localization accuracy may be as good orbetter than 50 cm-level accuracy.

Referring to FIG. 10B, a combination of antenna arrays and electronicsto determine the angle of arrival or angle of departure may be placed inproximity to the Smart Device. In some examples, a combination of two ormore antenna array devices 1020 and 1021 may be configured toindependently sit in a plane proximate to the Smart Device 1030. Theantenna arrays may interact with two or more wireless access points 1010and 1060 which may also be called locators. When the multiple Rays arecalculated from each of the locators 1010 and 1060 to each of theantenna array devices 1020 and 1021 a set of positional points for thetwo antenna array device may result. These positions may again be usedto calculate a Ray 1070 of direction between the two points. This Raymay represent the direction that the Smart Device is positioned in at aparticular time.

More complex combinations of the arrays of antennas may be configured toincrease the signal to noise of the system and improve accuracy. In anon-limiting example, three arrays of antennas 1020, 1021, and 1022, maybe found in referencing FIG. 10C. In some examples, the size of theantenna devices may be such that a combination of them may be largerthan a Smart Device that they are associated with. In some examples,such as the illustrated example in FIG. 10C, the arrays of antennas maybe overlapped in space. The result may physically relate to multipleoverlapped regions of the antenna Healthcare Facility. The resultinginteraction of the Healthcare Facilities may be very complex, andtraining of the algorithms to extract results from the signals receivedby the complicated Healthcare Facility may be required to achieve adirectional result. The integration of multiple Healthcare Facilitiescan improve signal-to-noise ratios related to transmission or receptionof signals in some examples; however, as the multiple results can beaveraged (in some embodiments, a weighted average) to extract adirection of the orientation of the Smart Device.

Referring now to FIG. 11, method steps are illustrated that may bepracticed in some embodiments of the present invention. At step 11, aunique identifier is established for each Node to be included in aself-verifying array. The unique identifier may be an alphanumericstring that is unique to available Nodes, a characteristic variable of asignal (e.g., characteristic frequency or wavelength), a public-keyencryption scheme, or any similar unique identifier.

At step 12, each Node (Node X) communicates with each other Node (NodeX+Y) with which Node X may establish wireless communications.

At step 13, sets of values for variables descriptive of respectivewireless communications are generated. Variables may include, forexample: which Nodes are involved in a wireless communication (which maybe determined for example via a unique Node identifier); timing valuesrelated to time of transmission of a data packet; timing values relatedto a time of arrival of a data packet; an angle of arrival of a wirelesstransmission; an angle of departure of a wireless transmission; astrength of a received wireless communication; a quality of a receivedwireless communication; or other variable. Each Node may generate a setof values for the variables for each wireless communication.

At step 14, optionally, each Node may record aspects of a wirelesscommunication that may influence accuracy of one or more values forvariables descriptive of respective wireless communications betweenNodes. Example of such aspects may include the presence of anobstruction to transmission of wireless communications, a strength of areceived transmission (for example a weak strength of a receivedtransmission may indicate a significant distance between the Nodes incommunication), and the like.

At step 15, each Node may store sets of values for the variables forrespective communications and aspects that may influence accuracy of thesets of values. In some embodiments, this step is optional; a Node maybe capable of immediately retransmitting a value for a variable withoutfirst storing it. In some embodiments, a Node may perform certaincomputations relating to the values for the variables, such as taking aweighted average of values received through multiple modalities orSensors.

At step 16, respective Nodes transmit respective sets of values for thevariables for respective communications and aspects that may influenceaccuracy of the sets of values to any other Node with wirelesscommunication range. In some embodiments, a Node may also transmit thesets of values for the variables for respective communications andaspects that may influence accuracy of the sets of values via hardwirecommunication.

At step 17, each Node within communication range receives thetransmitted sets of values for the variables and aspects that mayinfluence accuracy of values. By the process of generating sets ofvalues for variables of communications, receiving sets of values ofvariables for communications, and transmitting the same values, eachNode may acquire multiple sets of values relating to itself and to otherNodes, even Nodes that are out of range for direct communication and/orobstructed from direct communication. The multiple sets of values may beused to verify each other. In some embodiments, sets of outlier valuesmay be disregarded.

At step 18, using a controller with a processor and executable software,a position of a particular Node (X) may be generated based upon acomposite of sets of values, or a mathematical algorithm involvingmultiple sets of values. In addition, aspects that may influence thesets of variables may be given mathematical weight in generating aposition of Node (X).

At step 19, in some embodiments, a presence of an obstruction may beinferred based upon the multiple sets of values for variables incommunication. Still further a position of the perceived obstruction maybe generated based upon the same multiple sets of values for variablesin communication.

At step 20, a visual representation of a verified location for each Nodeincluded in the array may be generated, and in some embodiments, thevisual representation may include a position of a perceived obstruction.Each location is verified by sets of values for variables incommunications between multiple Nodes. Using this process, a position ofa Node may be made available to a Smart Device or another Node that isnot within direct communication range and/or is obstructed from directtransmission. Each Node generates values of variables for communicationthat may be used to determine a particular Node's position relative toother Nodes and/or a base position.

Referring now to FIG. 11A, a Healthcare Facility space 1100 having amultitude of wireless Nodes 1102-1106 is illustrated. Nodes 1102-1106are shown located within or proximate to Healthcare Facility space 1100.Nodes 1102-1106 include Transceivers operative to communicate via awireless modality, such as one or more of: Bluetooth 5.1; BLE5.1; Wi-FiRTT, infrared, and ultrasonic communications. In some examples, Nodes1102-1106 include components capable of supporting positioning and datatransfer functions useful in establishing a self-verifying array ofNodes (i.e., a SVAN).

Nodes 1102-1106 may establish a self-verifying array 1117 with directcommunication paths 1110-1115 between Nodes illustrated by the dashedlines between the Nodes 1102-1106 positioned at disparate locations.Nodes that are within direct communication range are shown formingdirect communication connections along the direct communications paths1110-1115. Communications between Nodes include data useful fordetermining one or both of: a position relative to each other; and aposition of a Node to a base position 1116. Direct communications withinthe self-verifying array may also provide improved signal to noiseratios. In some embodiments, Sensors may be co-located with one or moreNodes and in logical communication with the Nodes, thus allowingtransmission of Sensor data across the Nodes.

According to the present invention, the self-verifying array 1117enables overall separations of Nodes that are larger than the directcommunication range of the individual Nodes 1102-1106. In other words,self-verifying array 1117 may allow a single Node to transmit tolocations greater than the Node's own transmission limits using otherNodes in the self-verifying array. For example, Node 1102 and Node 1105may not be within a direct communication range of each other due to thedistance D1 between Node 1102 and Node 1105 exceeding a range supportedby a modality of communication used by Node 1102 and Node 1105. However,data generated at Sensor 1105A that is co-located with Node 1105 may betransmitted to Node 1104 and then to Node 1103 and then to Node 1101;alternatively, and/or in addition, data generated at Sensor 1105A may betransmitted to Node 1106 and then to Node 1102, thereby extending thecommunications range of the modality in use.

In addition to Sensor data, values for variables of communicationsbetween various Nodes 1102-1106 may be transmitted amongst each Node1102-1105, where the values may enable a determination of a relativeposition of respective Nodes 1102-1105 to each other and/or to a baseposition 1116. In this manner, a position of any two Nodes 1102-1105relative to each other and/or to the base position 1116 may begenerated. Verification of Node 1102-1105 positions is accomplished viageneration of a particular Node 1102-1105 in relation to another Node1102-1105 and/or a base position 1116 using multiple sets of values ofvariables involved in disparate communications between disparate Nodes1102-1105.

In an example, the Healthcare Facility space 1100 may be considered aBluetooth arena which is covered by a collection of Nodes 1102-1105operative to communicate with at least the BLE5.1 standard and therebyform a self-verifying array, such as self-verifying array 1117. In theHealthcare Facility space 1100, the self-verifying array 1117 mayestablish a base position 1116 from which positions of the various Nodes1102-1105 may be represented.

In some examples, the base position 1116 may be a spatially significantfeature such as a corner, door threshold, physically marked space, orthe like, which is established in a model sense with Nodes 1102-1105including Bluetooth Transceivers that are fixed within the space 1100.In other examples, the base position 1116 may be established at one ofthe stationary Node 1102-1105 locations.

Referring again to FIG. 11A, one exemplary Node (such as Smart DeviceNode 1102) may include an Agent-supported Smart Device. The Smart DeviceNode 1102 may be located at a fixed position and may serve as the baseposition. In some examples, the Smart Device may be a pad or touchscreen which is mounted to a wall position, or it may be a Kiosk-typedevice also located in a fixed position.

In other examples, a fixed Node 1103 may be located within theHealthcare Facility space 1100 such as at a ceiling-mounted position.Here too, this Node 1103 may be established as the base position forNodes 1102, 1104-1105 across the network. In other examples, a baseposition 1116 may be at a location offset from a physical, spatiallysignificant architectural feature such as a corner of a HealthcareFacility or a doorway.

An Agent supporting a Smart Device 1107 with a Bluetooth transmitter mayenter the Healthcare Facility space 1100 containing the self-verifyingarray 1117 and act as a Node in the self-verifying array. The variouspositioning capabilities of the various Nodes 1102-1105 in the space1100 may activate to provide location-positioning data to theAgent-supported Smart Device 1107. In some examples, a base positionunit is swapped to the Agent-supported Smart Device 1107, in which case,all positions may be dynamically updated relative to the Agent-supportedSmart device 1107. In some examples, multiple (and in some casestemporary) additional coordinate systems may be established in additionto a base definition of coordinate system which may have a fixed baseunit. Exemplary coordinate designations may include CartesianCoordinates, Polar Coordinates, Spherical Coordinates, and CylindricalCoordinates, wherein Bluetooth-type designations of AoD and/or AoA andradius may be represented as coordinates in a Polar, Spherical, orCylindrical Coordinate system.

There may be Nodes 1104 that are located upon equipment or appliances1104A, and may therefore be stationary in most cases. The Node 1104co-located with the appliance 1104A may be powered by the appliancepower supply and also have battery-backup aspects. In the exampleillustrated, the Node 1104 on the appliance 1104A may be classified asthe base unit. However, as illustrated, it may be located at a remoteposition from a doorway to the space. Thus, the use of a self-verifyingarray may allow for a remote Smart Device 1107 to be an active Node inthe space 100.

There may be Nodes 1105 that are located on wall buttons or inwall-positioned devices. Here too, such a device may be defined as thebase position unit. Such a device may be battery-powered and may requiremeans of battery replacement or charging. In some examples, the Node1105 may have a connection to utility power 1109 and or data conduit.The use of self-verifying array may allow for a User device (not shown)to be tied into a network that connects to the self-verifying array 1117that covers the bulk of the area of the Healthcare Facility space 100.

In some examples, a region 1 106A of the Healthcare Facility space 1101may be generally devoid of coverage to the self-verifying array 1117. Indesigning the communications environment of the space 1100, therefore, aNode 1106 with a Bluetooth transmitter may be fixedly located to aceiling, support pole, or other Healthcare Facility feature in a region1106A that is otherwise devoid of communications coverage.

A visual representation of a self-verifying array may include some orall of the Nodes include in the array and, in some embodiments, it willinclude a representation of a perceived obstruction based upon thevalues for communication variables. Some embodiments of a visualrepresentation may have one or both of layers of spatial grid definitionand polar coordinate definition. In a base layer, a coordinate systemfor the Healthcare Facility space may be established using a fixeddevice as a base unit. The origin of this first layer's coordinatesystem may be established as a zero point in numerous coordinate systemtypes such as cartesian, polar, cylindrical, spherical or othertopographical coordinate models.

In some examples, an overlay second layer may include a coordinatesystem which is spatially similar to the self-verifying array, where forexample, each connection of three devices may create a regionalcoordinate system, and the Healthcare Facility space 1100 is representedas a mosaic of local coordinate systems withinself-verifying-array-defined spaces. In some other examples, an overlaythird or more layer may be a dynamic coordinate system where a specificcommunication Node, which is mobile, is dynamically tracked as thecoordinate system origin and the rest of the space is adjusted relativeto the moving origin.

Various embodiments may include schemes and layers of coordinate systemdefinitions that become defined for a composite of self-verifying arrayNodes 1102-1105. In some examples, one or more of the coordinate layersmay be defined, tracked, and communicated by a single network memberdefined as a base position unit. In other examples, a SVAN maydistribute coordinate definition and communication to Nodes 1102-1105dynamically. A routine update of calculated and measured position andcoordinate system may be maintained that not only defines a coordinatesystem but also indicates where some or all self-verifying arrayconnected Nodes 1102-1105 are located on a grid system. A routine updateat a schedule of time may therefore track Nodes 1102-1105 that aremoving in time, recalculating their position.

In some examples, a Bluetooth-enabled device may not be authorized ormay not have the capabilities to enter the self-verifying array as aNode 1102-1105, but it may emit signals including identificationinformation and may receive communications from the self-verifyingarray. In such embodiments, the self-verifying array may identify thesenon-Node-type communication devices and establish their positions. Aswill be defined in more detail, in some examples, a positiondetermination for a particular non-Node device may be defined inreference to a Node 1102-1105 that the non-Node device communicateswith, along with an estimate of a range in which the non-Node device iscapable of communicating.

Referring now to FIG. 11B, a Smart Device may receive a communicationfrom a Node 1102-1105 in a self-verifying array, wherein thecommunication includes multiple positional coordinates for each Nodeincluded in the array. The communication may also include positionalcoordinates of items of interest associated with Nodes 1102-1105 on thenetwork, such as an item co-located with a Node 1102-1105. In someexamples, the network may be interrogated by the Smart Device to provideinformation related to one or more Nodes included in the self-verifyingarray. The data may be used by the Smart Device to generate a userinterface 1121 with a pictorial/image representation of the variousBluetooth transmitters and network Node devices. The representation mayutilize one or more coordinate systems. For example, a Smart Device 1120may portray the user interface 1121 may include image representation ofa region of the Healthcare Facility space which may be user selectableon the Smart Device. The image representation in the user interface 1121may include an origin 1122 designation for a particular coordinatelayer. In an example, where the coordinate layer is one where the originis dynamically updated for the position of the Agent, then the originmay represent the position at which the Agent is located.

In another example, an origin may be congruent with an origin of acoordinate layer for a spatially relevant origin and the Agent may ormay not be represented as an item on the user interface 1121. For thisexample, an Agent may be represented by position 1123. A pictorialrepresentation may show the Agent position 1123 and also presentparameters that refer to the Agent position such, as a two dimensionalcartesian reference 1126 and/or a polar notation reference 1127. Otherwireless Nodes of relevance 1124 and 1125, within the scale of the imagemay be portrayed as well.

In some examples, the self-verifying array may include a feature wheresome or all of the network connected Nodes have identificationinformation associated with them. Each of the Nodes may have stored(locally or in another network data layer) a multitude of referencessuch as an identification information internal to a transceiver. Forexample, a Bluetooth transceiver may transmit identification informationlike a 48-bit Bluetooth transceiver address, a user-assignable name tothe transmitter, or a user-assignable name to an element that thetransmitter is a component of may be stored. As an example of anassignable name, in a non-limiting sense, an appliance may be a Node inself-verifying array which may have the name “Downstairs Refrigerator.”

In some examples, identification information may be related to differentlevels of security access that a Node may access, store, transmit, andthe like. Information useful for generation of a user interface may betransmitted from a Node via IP on a digital communications network, suchas the Internet, and a user may be located anywhere that is connected tothe communications network. In this manner, a user interface may bepresented to a remote user regardless of the user's location.

In some examples, a stable base unit of the self-verifying array may actas a standard repository and access point for all information stored orarchived for the self-verifying array. In other examples, the datastorage may be distributed across the self-verifying array. In anexample, a standard portion of the data stored on the self-verifyingarray, such as in a non-limiting sense, the identifications, timestamps,positions, characteristics, and security levels of all Nodes, andidentifications and positions of all transmitters within the HealthcareFacility space/self-verifying array extent may be assembled into a datatable/layer.

In some examples, a routine transmittal of a data table/layer may bebroadcast throughout the self-verifying array. In an example, everyself-verifying array Node may have an assigned broadcast order such thatat a standard time indexed to the broadcast order, it will broadcast itscurrent version of the table. All Nodes within range of a transmittingNode will receive the table and update it as the current version. Then,at their prescribed broadcast time, they might transmit the table. Theremay be rules that overlay such a broadcast to ensure that current datais not updated with previous versions for a Node that does not receivethe update before its broadcast time. Such rules may also preventunauthorized alteration of data through hacking or other networkpenetration. The Nodes may act as participants in a Blockchain in thismanner.

One such rule may be that transmission may occur only when the datatable has been updated at the Node. Another rule may inhibittransmission for any Node that is dynamic/moving, or alternativelyinitiate immediate transceiving for a Node that is dynamic/moving.Transmission may include diverse types of data. Periodic transmissionsmay be timed based upon a time needed for a transmission, energyrequired for transmission, available energy, receipt of new data, andthe like. Therefore, each Node may have a configuration setting thatdefines conditions when, how, and for how long it transceives. Suchcondition may include, for example, a frequency upon which it listensfor and upon which it communicates data. The various definitions ofcoordinate layers may be transmitted.

In some examples, a remote user-connected digital communications networkto a self-verifying array Node or a Bluetooth device entering into aself-verifying array Node may request a copy of a standard data tabletransmission. The data table transmission may include positions of Nodesrelative to a fixed origin, to the user position, to particular fixedNodes of the network or a collection of some or all of these.

Some data layers may be created to store Sensor information that may beobtained at some or all of the Nodes. The data layer may be segregatedbased on types of Sensor data. For example, all Nodes of aself-verifying array may include a Sensor providing a quantification ofone or more of: ambient temperature, humidity, water presence, currentdraw, vibration, movement, image data, and the like. A timestampedreading of this Sensor quantification may be included into a data layeralong with co-located Node identification information.

In other examples, a subset of the devices may include an ambient-lightSensor as part of its infrastructure. In this case, another data layermay be created for this type of Sensor data. In some examples, thepictorial image representation 1121 may include one or more of the datalayer Sensor information. The pictorial image representation 1121 mayrepresent the Sensor readings in a textual form, or in other mannerssuch as a color indication at a Node position or at regions around aNode position.

Referring to FIG. 12A, another representation of a SVAN 1210 isdisplayed. In this embodiment, space 1200 may include HealthcareFacilities 1211 and 1212. Healthcare Facilities 1211 and 1212 may have avariety of different characteristics that may impact the performance ofself-verifying array 1210. For example, Healthcare Facilities 1211 and1212 may be physically closed (e.g., walls, solid Healthcare Facilities)or partially closed (e.g., shelves). Healthcare Facilities 1211 and 1212may also comprise solid materials and the like. Accordingly, thepresence of these Healthcare Facilities may change the transmissioncharacteristics of a wireless network (e.g., Bluetooth). Some HealthcareFacilities may block signals, impede signals, or partially impedesignals. For example, shelves may have physical regions that block andother regions that are fully transmissive.

Shelves may provide an example in which the Healthcare Facilities in thespace 1200 may have dynamic characteristics. Such dynamiccharacteristics may make self-verifying arrays (and correspondingspatial schema) more useful than traditional mapping methods. Thesecharacteristics may create different operational characteristics forself-verifying arrays.

In another sense, a shelf may hold a combination of both fixed andmobile devices that comprise a self-verifying array in the space at somegiven time. This may provide more accurate and more dynamic coverage forthe schema. For example, the space 1200 may be interspersed with anassembly of fixed (or roughly fixed) network Nodes that form a gridpattern (as an example) to ensure that a minimal self-verifying arraymay be established that covers the entire space 1200. This minimalnetwork may be supplemented with “migrant” Nodes that are moved into thespace 1200 and become part of the SVAN 1210. From a signal coverageperspective, more participants may improve characteristics. However,more participants may increase information traffic levels, and a controlformalism that limits bandwidth differentially to different networkparticipants may be necessary in some examples.

In FIG. 12A, an example of a space 1200 with shelving units that make upHealthcare Facilities 1211 and 1212 is illustrated. The space may have a“global” reference point 1204 for positioning. There may be fixedwireless communication Nodes 1201, 1202, and 1203 (for this example, allNodes are at least compliant with Bluetooth 5.1 and transmit at least asBluetooth radio transmitters; however, this deployment is merelyillustrative). The fixed wireless communication Nodes 1201-1203 may alsoinclude other aspects/components to them such as an integrated camerasystem. The integrated camera system may provide a visual perspective ofa portion of the space that its corresponding wireless radios may cover.In a self-verifying array, Nodes may be collocated or located relativeto a Sensor, such as an image-capture device. Based on a known setposition of the Sensor relative to the Node, the Node may transmitinformation captured by the Sensor to other Nodes. Accordingly, a Nodeout of both Sensor and radio range of another Node may still receivedata from the Sensor through the array. The data from the Sensorreflects a range of data in which a physical characteristic isquantified or capable of being quantified by the Sensor. For example, aSensor may be an image-capture device, limited in range by bothwavelength of image capture (e.g., limited to infrared) and spatialrange (e.g., field of view of the image-capture device). This may beparticularly desirable in embodiments in which the self-verifying arrayis deployed in or adjacent to an environment having a characteristicadverse to a Sensor. For example, the low temperatures may impairoperation of certain Sensors. Through the self-verifying array comprisedof these Nodes, data from the Sensors may be freely transferred amongthe Nodes, including through fiber optic communication throughout thefreezer. It may be desirable to deploy spectrometers and hydrometers inthis fashion. Moreover, redundant Nodes may be able to redirect Sensorreadings from one Node to a base Node, especially in scenarios when anoptimal Node pathway may be obstructed, such as by shelving.

The space 1200 may also include other fixed Nodes, such as Node 1223,that may not have cameras included. Node 1223 may be important to ensurethat regardless of a makeup of migrant communication Nodes, fixedwireless communication Nodes may be able to form a complete SVAN space1200 in the absence of items that block radio transmissions. There mayalso be migrant communication Nodes 1220-1222 affixed on packages,materials, or other items that may be placed and/or stored upon theshelving units.

In some examples, at least a subset of the SVAN-participant Nodes maycommunicate periodically. The various aspects of data layercommunications as have been discussed may occur between the Nodes of thenetwork. At a base level, at least a subset of the Bluetoothtransmitters may periodically transmit information such as their uniqueidentifiers, time stamps, known positions and the like. In someembodiments, Nodes may transmit between each other or to a baseinformation about variables between the Nodes, such as computeddistances or angles between the Nodes. A Node may receive transmissionsfrom other transmitters and may store the transmissions. In someexamples, a Node may act as a repeater by receiving a transmission andthen retransmitting the received transmission. A Node acting as arepeater may then take various actions related to the data involved. Inan example, the Node may effectively just stream the data where nostorage of any kind is made. Alternatively, a Node may store thetransmission, then retransmit the transmission (immediately or after adelay) and then delete the stored data. In other examples, a repeaterNode may store a received transmission and then retransmit thetransmission either for a stated number of times, or until some kind ofsignal is received after a transmission. Thereafter the Node may alsodelete the data. In some examples, a Node may store data from anincoming transmission and take the various retransmission actions ashave been defined, but then not delete data until its data store isfilled. At that point, it may either delete some or all of the storeddata, or it may just overwrite stored data with new incoming data andthen clean up any remaining data with a deletion or other process.

When a Node acts as a repeater, it may receive data and then merelyretransmit the data. Alternatively, a repeater Node may either use thetransmission of data or the time during the transmission to acquire andcalculate its position and potentially the position of othertransmitters in range. During retransmission of the received data, itmay also include in the transmission calculations of its own positionrelative to other transmitters, calculations of other transmitterpositions relative to itself, calculations of its own and othertransmitter positions relative to an origin, and the like. It may alsoinclude other information such as a time stamp for the calculation ofpositions.

The combined elements of a SVAN may be operated in a way to optimizepower management. Some of the network Nodes and transmitting elementsmay operate in connection with power-providing utility connections inthe Healthcare Facility. Other network Nodes may operate on batterypower. Each of the Nodes may self-identify its power source, and eitherat a decision of a centralized controller or by a cooperative decisionmaking process, optimized decisions may be taken relative to datatransmission, low-power operational modes, data storage and the like. Insome examples, where multiple Nodes provide redundant coverage andprovide information to a central bridge acting as a repeater, the Nodesmay alternate in operation to share the power-draw on individual Nodes.For example, if one of these Nodes is connected to a utility powersource, that Node may take the full load. The battery-powered elementsmay have charge-level detectors and may be able to communicate theirpower-storage level through the network. Accordingly, an optimizationmay reduce traffic on the lower battery capacity Nodes.

In some examples of operations, a transmitting Node may transmit amessage for a number of redundant cycles to ensure that receivers have achance to detect the message and receive it. In low power operatingenvironments, receivers may transmit acknowledgements that messages havebeen received. If a base unit of the network acknowledges receipt of themessage, control may be transferred to the base unit to ensure that themessage is received by all appropriate network members. Messagereceivers may make a position determination and broadcast their positionif it has changed. A self-verifying array of Bluetooth receivers mayprovide one of a number of Transceiver network layers where othercommunication protocols based on different standards or frequencies ormodalities of transmission may be employed, such as Wi-Fi, UWB, Cellularbandwidth, ultrasonic, infrared and the like. A Node that is a member ofdifferent network layers may communicate and receive data between thedifferent network layers in addition to communicating through aBluetooth low-energy self-verifying array.

Referring to FIG. 12B, an illustration of the view from a camera on anetwork Node position is presented. A Smart Device 1250 may interactwith the self-verifying array and communicate a desire to receive imagesor video from a camera. In an example, referring back to FIG. 12A, theNode 1201 may have a camera that produces an image that in FIG. 12B ispresented on the smart phone as image 1260. Processing either on theSmart Device or on processors connected to the network may collectinformation about the location of other network Nodes through thevarious processes as described herein and then determine a correctlocation on the collected image to display icons over the position ofthe Nodes 1221 and 1223. There may be numerous other types ofinformation that may be overlaid onto the imagery such as Sensormeasurements, textual presentations of data values, data related tostatus and transactions on the network, and the like.

In some examples, the cameras may be maintained in a fixed position orpositioned on mounts that can allow the plane of view of the camera tobe moved. The Smart Device 1250 may be supported by an agent such thatit is oriented in such a manner to point to a particular view-plane fromthe perspective of the screen. This may either be from a perspective oflooking through the smart screen (i.e., in the field of view of a cameraassociated with the Smart Device 1250) or, in other examples, supportinga screen of a Smart Device flat (i.e., parallel to a ground plane) andpointing in a direction of interest based on a direction of orientationof the Smart Device 1250. In related applications, it is disclosed thata direction of interest may be determined based on wirelesscommunications. In some examples, orientation aspects of Transceiversupon the Smart Device 1250 may be employed to determine Rays of interestof the user (for example, to point the Smart Device 1250 in a directionof interest to the user). In other examples, other Sensors on the SmartDevice such as accelerometers, magnetometers, and the like may be ableto infer a direction in which the Smart Device is pointed. Once adirection of interest is determined, the camera may be moved tocorrespond to a plane perpendicular to a Ray associated with thedirection of interest (i.e., such that the Ray is a normal vector to theplane). An assessment of items of interest whose coordinates may lie inthe field of view of the selected view plane may be made, thuspresenting data to the user and allowing the user to filter out or learnmore about the items.

Referring now to FIG. 12C, another type of presentation is illustratedwhere a plan view or map view of the space 1270 may be presented. Insome examples, a Smart Device may access a virtual model (AVM) or otherspatial schema that contains spatial data relating to the space that theuser is in. The view may also include a presentation of the HealthcareFacility, including features such as walls, doors, supports, shelving,equipment and the like. The location of network Nodes may be illustratedby icons 1273 at the two-dimensional locations determined by the variousposition-mapping processes as described herein. The location of the user1271 may also be superimposed upon the map with a different icon, andthis location may be dynamically updated as the user 1271 is moving.There may also be an iconic representation of the heading 1272 of theuser which may be determined by the wireless protocols as discussedherein or it may be estimated based on the time-evolution of theposition of the user. Items of interest may be presented on the map atany location surrounding the user such as in front, to the side orbehind the user. In some other examples, only items in the view-plane(determined by the heading of the user) may be illustrated on the SmartDevice 1250. Textual data and other types of information display such ascolor gradation may also be superimposed on the map to represent datavalues such as Sensor input, network characteristics, and the like. Insome examples, a relative height of items of interest relative to thefloor or to the Smart Device may be presented on the image as a textpresentation.

Referring to FIG. 12D an extension of location tracking is illustratedfor devices that do not have positional capabilities (such as a GPS) butcan respond to transmissions within a certain distance. The range of thedevice can allow a localization to be within a certain distance from aNode. In some examples, nanowatt Bluetooth Nodes that operate withoutbattery power may be cheaply attached to items for tracking and/or canbe affixed with Sensors to provide data acquisition. These devices maytypically depend upon energy harvesting for their operation. In someexamples, a transmission from a Node of the SVAN may itself carry enoughenergy to enable an RFID tag or other type of passive tag to respondwith a low-energy transmission. Accordingly, a Node may transmitsufficient energy to activate an RFID; such as, for example, an RFIDthat has an identifier of an item to which it is affixed. The devicesmay be unable to perform all the wireless functions discussed herein,but they may be capable of transmitting identification data and perhapsSensor data.

In some examples, RFIDs may be employed. Bluetooth self-verifying arrayNodes may also have incorporated RFID tag readers that can similarlytransmit a unique identifier in response to a transmission from theself-verifying array Node. In FIG. 12D, a Smart Device 1250 may displaya map-form presentation of a space 1270 (similar to the previousdiscussion with SVAN Nodes located in a two-dimensional coordinatesystem). In an exemplary embodiment, ultralow-power Bluetooth Nodes orRFID Nodes may be located on elements such as packages or equipmentplaced on the illustrated shelves. In response to transmissions from theSVAN Nodes, various low-power tags may respond. In some examples, thelocalization of the low-power tag may be based on further refinement ofmeasurements, such as measurements of the returned signal strength.

Referring again to FIG. 12D, a SVAN Node 1273 may detect twotransmitting Nodes (labeled “A” 1280 and “B” 1281 in FIG. 12D). SinceNode “B” 1281 may also be detected by a neighboring SVAN Node 1274, itmay be inferred that the Node may be in a region located between the twoSVAN Nodes (i.e., since Node “B” is located in the overlap of thecoverage areas of SVAN Nodes 1273 and 1274, it is likely that Node “B”is located somewhere between SVAN Nodes 1273 and 1274). Other Nodesreceived by SVAN Node 1274, such as Nodes 1282 and 1284, may not bedetected by other SVAN Nodes and thus may be located in non-overlappedregions. As a further illustration, Node “D” 1283 may be detected bothby Nodes 1274 and 1275. Node “F” 1285 may be detected by three differentSVAN Nodes 1274, 1275 and 1276. Thus, the position of Node “F” may bedetermined with a high level of confidence. Node “G” 1286 may be locatedonly in SVAN Node 1276. Node “H” 1287 may be located only in SVAN Node1275. This data may provide localization information for regions aroundBluetooth SVAN Nodes.

The non-limiting example discussed has included a Healthcare Facilitywith obstructions in the form of shelves; however, obstructions mayinclude any item that interferes with or inhibits or decreases qualityof inter-Node communication within the self-verifying array.

Referring to FIG. 12E, elements of a self-verifying array in a space1270 may have dynamic locations and their movement may haveramification. In an example, SVAN Node 1276 may physically move toanother location. The various self-verifying array data layers relatingto location of elements may update for this move and the updated tablesmay be communicated to the Nodes of the network as has been described.At the new location, SVAN Node 1276 may signal to devices in its newregion for response. There may be transmitting Nodes and RFIDS that areand have been in the new region that SVAN Node 1276 has moved to. Forexample, item “I” 1294 may be located by SVAN Node 1276 in its newlocation. As well, items with transmitting Nodes on them may also moveas illustrated by the detected movement of item “D” 1283. Another typeof change may be that when Node 1276 occupies its new location, item “H”1287 may be detected in the region of two network Nodes now, andtherefore its location may be refined to that region that the twonetwork Nodes overlap in coverage.

Referring now to FIG. 12F, an illustration of a complex space whereregions within the space may block or impede wireless communications isprovided. In some examples, parts of a Healthcare Facility like internalwalls, conduits, equipment, structural beams, and elevators/shafts mayprovide permanent or temporary blockage of wireless transmission. Forexample, as an elevator passes through a particular floor, it may blocktransmissions through the elevator shaft that may otherwise occur.Shelves may be temporarily have materials or equipment moved topositions on the shelves as illustrated by regions 1297 and 1298 thatmay block wireless transmissions. The self-verifying array 1200 and itsNodes 1201-1203 and 1220-1223 may be able to cooperate and providecoverage of the self-verifying array around such blockage. For example,a wireless communication Node 1296 may be too far from Node 1203 tocommunicate directly with it. And, communication from other fixed Nodeslike 1201 and 1202 may be blocked by the blockage as discussed. The SVANmay still communicate 1295 with the SVAN Node 1296 by connecting a path1299 shown in thick dashed lines essentially communicating with line ofsight paths around the blockages.

Referring to FIG. 13A, mobile elements such as UAV and UGV with wirelesstransmitting Nodes attached are illustrated. Mobile elements mayfunction within self-verifying arrays to create dynamic physicalextensions of the self-verifying array. The mobile elements 1310,1320and 1330 are illustrated as UAVs. As the mobile elements move, they mayallow other Nodes or wireless access Nodes to make communications. Insome examples, there may be at least a first fixed element 1300 that ispart of the SVAN. It may define an origin point in some systems, but inother examples, it may be offset from an origin point 1310. As a mobileelement 1320 moves through space, its position may be updated bycommunication between the fixed element 1300 and itself 1320. Thelocation determine may in some examples be referenced to the origin. Inpolar notation, it may be located at r₂,θ₂, for example, where theangular components are taken with respect to an axis having at least apoint perpendicular to mobile element 1320 (e.g., a ground plane).

When the mobile elements are able to communicate with a fixed element, adetermination of the fixed element's position relative to a localcoordinate system may be straightforward since the fixed element canknow its position with relatively high accuracy. A moving device thatcan continually measure its position relative to the fixed element cancome close to that accuracy in position determination as well and canimprove its determination by taking more measurements. As mentionedpreviously, elements in an operating space may be either statically ordynamically positioned and block or impede wireless transmission throughthem. Mobile communication elements create interesting solutions in suchan environment because a team of communication elements can positionitself in such a manner to “look around” such difficult transmissionzones. At the same time, the difficult transmission zone may block theability of a mobile element from communicating directly with a fixedcommunication Node. In such cases, a first mobile element may determineits position relative to a second mobile element, where the secondmobile element has communication capability with fixed self-verifyingarray communication Nodes. In some examples, a self-verifying array mayconsist entirely of mobile elements, and then its practical coordinatesystem may be a local one that is determined in a moving coordinatesystem related to one or more of the mobile elements relative position.

Referring now to FIG. 13B, an exemplary embodiment of thisnon-line-of-sight position detection is shown. In some examples, theremay be mobile elements 1350, 1351 with wireless communicationscapabilities that create at least a portion of a SVAN of wirelesscommunicating devices. In some examples, the wireless communicatingdevices may include capability for Bluetooth protocol communications. Instill further examples, the Bluetooth protocol communications devicesmay include capabilities for establishing self-verifying arrays as wellas capabilities of performing positioning based on AoA measurements suchas is defined in the Bluetooth 5.1 standard. A fixed element 1300 whichhas a known offset to position T₁ may locate a mobile Node 1350 (such asa UAV) at position T₂ in accordance with the orienteering methodsdescribed above. In some examples, the mobile Node 1350 at position T₂may have moved into position T₂ in order to have a line-of-sight withthe mobile element 1351 at position T₃. For illustration and discussion,the devices are shown with line-of-sight between T₁ and T₂ and betweenT₂ and T₃. In some examples, the wireless communication modalitiesdescribed herein may be capable of passing through walls or otherblockades, however, a blockade may resist or interfere with suchwireless transmission. In some examples, a wireless modality deployedmay just not be able to penetrate a given wall or other obstruction.

Accordingly, the second reference Transceiver T₂ of the mobile Node1350, due to its movement, may be deployed within the line of sight ofboth T₁ and T₃ to assist with determining an accurate location of T₃notwithstanding the lack of sight between T₁ and T₃. Although thisFigure shows a lack of line-of-sight between fixed device 1300 and themobile element 1351 as caused by blockade B 1370, line-of-sight may alsobe defeated by, for example, an excessive distance between T₁ and T₃(i.e., r₃ 1365). For example, Bluetooth 5.1 has a range of approximately1.4 km at certain frequencies. Thus, where r₃>>1.4 km, the presentmethod may be desirable for Transceivers that use Bluetooth 5.1.

Using the methods described above, the fixed element 1300 referenced toT₁ may determine the location of the mobile Node 1350 T₂ byline-of-sight communication. For example, the location may be determinedbased on the angle of arrival of signals, as angle θ₁ 1361 from T₂ andthe distance r₁ 1360 between T₁ and T₂ as measured by timing signals.For ease of calculations and discussion, the local coordinate system ofmobile Node 1350 at T₂ may be oriented to a reference direction 1352pointed to location T₁ from T₂. The mobile Node 1350 at T₂ may in turndetect the location of the mobile element 1351 at T₃, using (in someembodiments) the methods described herein. If T₂ uses the methodsdescribed herein to determine the location of T₃, it may determine thatthe mobile element 1351 at T₃ is located a distance r₂ 1362 from it andrelative to its reference direction 1352, it may be located at an angleθ₂ 1363.

The mobile Node 1350 may aid the system of SVAN elements to determinethe positions of each of the element relative to each other by relayingthe relative location of the mobile element 1351 at T₃ as detected tothe fixed element at 1300 which is referenced to the point T₁. One ofthe components of the SVAN, which may even include connected serversthat are connected to one of the self-verifying array Nodes, may thenperform algorithmic calculations to trigonometrically compute severaluseful values, such as: the effective distance between T₁ and T₃,notwithstanding blockade B 1370, i.e., r₃ 1365; the effective angle ofarrival of a signal from T₃, i.e., θ₃ 1366; the angle between T₃ and anaxis formed by T₁, i.e., θ₁₋₃ 1364; and the like.

Referring briefly to FIG. 15, an exemplary method of computing thedistance between two nodes not having line-of-sight communicationsbetween each other is shown. In this example, it will be assumed thatthe nodes and the vectors between them can accurately be projected intoa two-dimensional, coplanar space, as shown in FIG. 15. This may also beappropriate in situations in which, for example, three linearlyindependent axes can be determined (e.g., x, y, and z), but one of thoseaxes is not of interest.

For the purposes of this discussion, let the distances between Nodes T₁and T₂, T₂ and T₃, and T₃ and T₁ be r₁, r₂, and r₃, respectively. Letthe angles between r₃ and r₁, r₁ and r₂, and r₂ and r₃ be θ₁, θ₂, andθ₃, respectively. As described above, the magnitudes of r₁ and r₂ may beknown using the methods disclosed herein. The present invention alsoallows the position of T₃ to be communicated to T₁ using T₂ as a relayin a variety of ways; one exemplary way is as follows.

A straightforward way of computing the magnitude of r₃ is to use the lawof cosines. Doing so requires knowledge of at least θ₁, θ₂, or θ₃. θ₂can be determined in multiple ways, depending on the specifics of thedeployment of T₁, T₂, and T₃, as well as the specific Bluetooth 5.1implementations of each. For example, in some embodiments, θ₂ may merelybe any of: the angle of arrival at T₂ or the angle of departure at T₂.In embodiments in which a central controller effectively creates a mapof the Nodes and translates them into a coordinate system, then θ₂ maybe determined using a dot product or other norm between the vectorsrepresented by r₁ and r₂. In other embodiments, θ₂ may be determinedgeometrically as discussed in further detail below. In still otherembodiments (particularly those employing a central controller), thevector represented by r₂ may be translated to the origin (shown in FIG.15 as T₁) or otherwise measured to determine its magnitudes in each axisof the chosen coordinate system. This may then be used to determine themagnitude of r₃, as in the embodiment shown in FIG. 15, r₃ is the vectorsum of r₁ and r₂.

Assuming r₁, r₂, and θ₂ are known with accuracy, then the law of cosinesprovides that r₃ is simply equal to the positive square root of r₁ ²+r₂²−₂r₁r₂ cos(θ₂). (This computation may also be applicable inthree-dimensional models.) In practice, however, some or all of thesequantities may be subject to uncertainty. Accordingly, in someembodiments, several methods of computing r₃ (some of which arediscussed below) may be used, and a weighted average of thesecomputations may be taken to more accurately determine r₃. Moreover, themethods discussed below may produce additional quantities that may bedesirable in some embodiments, such as a virtual angle of arrival of asignal from node T₃ to node T₁.

In some embodiments, θ₂ may not be cleanly determinable as simply anangle of arrival/departure of a signal at T₂. However, in someembodiments, the angles of arrival/departure at T₂ may be determinedwith reference to an axis drawn parallel to the x axis, as shown indashed lines in the figure. Let these angles be φ₁ and φ₂. If φ₁ and φ₂are determined with accuracy, then theta₂ is 180°−φ₁−φ₂, and thecomputation of r₃ can proceed as discussed above.

Given r₃, other useful quantities may be computed. For example, althoughthe figure shows θ₃, it may not be immediately quantifiable as an angleof arrival/departure because θ₃ represents the angle between r₂ (i.e.,the vector connecting T₂ to T₃, the magnitude of which is known a prioriin some embodiments due to the line-of-sight tracking described herein)and r₃ (which is a virtual vector that has unknown characteristics apriori due to the lack of a line of sight between T₃ and T₁). But oncer₃ and θ₂ have been determined, then θ₃ is the arcsine of (r₁/r₃) sinθ₂. Similarly, θ₁ is the arcsine of (r₂/r₃) sin θ₂.

Referring back to FIG. 13B, analysis techniques, such asartificial-intelligence techniques, may also use a difference in aposition calculated trigonometrically and via delayed line-of-sight tocalculate an interference factor of a particular wall, material, etc.(such as blockade B). This may be used in subsequent transmissions thatmay pass through the particular wall, material, etc. to more accuratelyestimate the impact of the wall, material, etc. on the transmission.While the blockade B 1370 is stationary and static, it may be possibleto determine a calibration factor for signal changes caused by blockadeB 1370 that may allow for attenuated signals that come fromself-verifying array Nodes that are behind the blockade to none the lessbe directly estimated for their relative position.

In addition, a known delay can be used to determine attributes of anobstruction, such as material type, thickness, proximity, etc. This maybe particularly true when the blockade is uniform in itscharacteristics. Moreover, the trigonometric techniques discussed hereinmay assist in determining a lack of an obstruction between T₁ and T₂ ata given wavelength by comparing the expected trigonometric result withan empirically determined line-of-sight result.

It may be useful in controlling a particular space, to utilize a team ofmobile devices to survey and surveil the space. In addition to theability to surveil a region that has regions of blocked/impededtransmission, the mobile network can establish routine (but transitory)bridge links in a self-verifying array to communication Nodes that areremote, as has been described. In addition to these abilities, a mobileelement that has an RFID reader capability may also pass over a spaceand “inventory” RFID tags attached to items for security, location andcondition tracking.

As mentioned previously, low-energy Bluetooth-based Nodes may also beinterrogated by mobile elements where these Nodes may also providesensing capabilities. As a non-limiting example, a construction site maybe modelled in an early version of an AVM for the Healthcare Facilityand it may track the location of components that will be assembled intothe Healthcare Facility as well as tools that may be used to constructthe Healthcare Facility as they arrive and, in some cases, leave a jobsite.

In some embodiments, a mobile Node is moved about to multiple locationswithin a physical area, such as during variations occurring during aconstruction job site. As the Node is moved, a height andtwo-dimensional coordinates of the mobile Node may be varied such thatit becomes possible for the mobile Node to communicate with other Nodesin or proximate to the physical area.

In some embodiments, the mobile Node may additionally communicate withother transceiver, such as a Bluetooth Node transmitter, an RFIDtransceiver, ultrasonic transceiver, infrared transceiver and the like.In some embodiments, the mobile Node may additional transmit wirelessenergy to a receiving Node, RFID, or transmitter Node specifically toenergize the receiving Node, RFID, or transmitter Node, and enabletransceiving by the energy receiving Node, RFID, or transmitter Node.

Referring now to FIG. 14, method steps that may be implemented in someembodiments of the present invention are illustrated. At method step1401, in some examples, a user may begin by installing wireless accesspoints into a building Healthcare Facility as it is built. In otherembodiments, the wireless access points may be added into the HealthcareFacility after it is built.

Continuing to method step 1402, a process may next be initiated that mayestablish a self-verifying array between the installed wireless accesspoints and other devices that are within the communications range of theinstalled wireless access points. Security protocols may control whethera particular communications element that is within range of such aself-verifying array may gain access.

Continuing to method step 1403, the self-verifying array may detect anentry of a wireless transmitter into an area covered by theself-verifying array. Entry may involve a physical movement of thewireless transmitter or the virtual movement of the coverage of theself-verifying array to include the wireless transmitter. Entry may alsoinclude reception of a previously unreceived signal from a wirelesstransmitter. In some embodiments, entry may include reception of apreviously unreceived frequency of a signal from a wireless transmitter.For example, it may be desirable not to detect the wireless transmitteruntil a chosen time, at which point a switch or other apparatus may varythe frequency of the signal from the wireless transmitter.

Depending on various security protocols and generalized networkprotocols, an optional method step at 1404 may be performed toincorporate a newly detected wireless transmitter (such as a mobiledevice) into communications with the self-verifying array. Proceeding toStep 1405, the network may optionally be configured by a user to directa movement of one of its mobile wireless access points into a newlocation while still maintaining its communications capabilities withthe self-verifying array. Proceeding to Step 1406, the network mayoptionally be configured by a user to direct a movement of one of itsmobile wireless access points to a location where it can simultaneouslybe connected to the self-verifying array while also establishingcommunications interchange with a device capable of wirelesscommunications where the device may otherwise not be in range with theself-verifying array.

Commercial Implementations of Self-Verifying Array of Nodes

Self-verifying arrays of Nodes are applicable in many diverse commercialimplementations. The following paragraphs describe several diverseimplementations utilizing a SVAN.

Referring now to FIG. 16, method steps are illustrated for deploying aSVAN to quantify conditions in a Healthcare Facility. The HealthcareFacility may include, for example, patient rooms, hallways, Resourcerooms and the like.

At step 1601, a first Node may be fixedly attached to, placed inside of,or otherwise co-located with a transport apparatus. The Node will movewith the transport apparatus as the transport apparatus moves.

At step 1602, a unique identifier associated with the first Node mayalso be associated with the transport apparatus with which the Node isco-located. For example, a database may store an association with theunique identifier of the first Node with a Transport apparatusIdentification Number (VIN) of the transport apparatus.

At step 1603, reference position Nodes other than the first Node may belocated at strategic placements within or proximate to the HealthcareFacility. In some embodiments, the strategic placements selected forreference point Nodes may be based upon one or more of: a shape ofHealthcare Facility; a wireless modality distance capability; a presenceof obstacles within an area occupied by a SVAN; obstacles to wirelesstransmission, such as medical equipment and the like.

At step 1604, one or more Nodes included in a SVAN may be designated asa Base Node. Base Nodes may be operative to perform functions notnecessarily performed by Nodes that are not Base Nodes. For example,Base Nodes may aggregate data over time, perform controller functions,transmit data via more than one wireless modality, be powered byutility-based alternating current, or communicate via a hardwired medium(e.g., via ethernet cabling).

At step 1605, one or more of the Nodes may communicate with other Nodes.Preferably, each Node will communicate with each other node within rangeof a communication Modality. In some embodiments, a pattern of Nodecommunication may be followed.

At step 1606, in some embodiments, a pattern of communication maystagger a time of wireless communication in order to avoid interferenceof one communication by another communication. A pattern ofcommunication may therefore include a “cascade” or hierarchical tree ofwireless communication transmission and receipt. For example a Base Nodemay communicate first, followed by a first generation of Nodes thatreceive a communication from the Base Node, and followed bycommunicating from the first generation of Nodes with a secondgeneration of Nodes (e.g. Nodes that are out of range or obstructed fromcommunicating with the Base Node), then to third generation Nodes, etc.

At step 1607, one or more Nodes within the SVAN may be designated tocommunicate with a network access device extraneous to the SVAN. Forexample, a designated Node may aggregate data, such as an aggregation ofvalues for communication variables or sensor-generated data; andcommunicate the aggregated data to a destination outside of the SVAN(such as, via a cellular transmission or an IP Protocol transmission).

At step 1608, in some embodiments, a SVAN may be defined based upon anability of SVAN participant Nodes to communicate with each other via aprimary communication Modality. For example, a primary communicationmodality may include a Bluetooth modality, Wi-Fi, Wi-Fi RTT, sub-GHzradio transmission and the like. A secondary communication modality mayinclude IP transmission, a cellular transmission, sub-GHz communicationand the like.

At step 1609, some Nodes may be excluded, based upon an inclusion orexclusion criteria. For example, in some embodiments, only Nodes withunique IDs may be included in a SVAN, or only Nodes with unique IDsassociated with transport apparatus prepped for deployment (e.g.immediate use) may be included in a SVAN, alternatively, Nodes with IDsassociated with transport apparatus recently made available due todelivery of a patient and/or a transport apparatus that is occupied maybe excluded from a SVAN.

At step 1610, communication variable values may be aggregated. Forexample, one or more Nodes or a controller may aggregate and store datathat is based upon, or quantifies, what transpires during a wirelesscommunication. Examples of data that quantifies, or is based upon, whattranspires during a wireless communication, may include, by way ofnon-limiting example, one or more of: a time of transmission, a time ofreceipt of a transmission, a phase angle of receipt of a transmission ofa single antenna, a respective phase angle of receipt of sametransmission by multiple antennas (which may include multiple antennasin one or more arrays of antennas). Other variables may include anamplitude of a received transmission, and a noise factor of a receivedtransmission.

At step 1611, a respective location of some or all of the Nodes in theSVAN may be generated, based upon the values for communication variablesthat are descriptive of communications with the respective nodes.

At step 1612, in some embodiments, an algorithm (such as those discussedherein) may be provided with values from the aggregated communicationvariable values to determine a location of a Node. Multiple sets ofvalues and/or multiple algorithms may be used to disparately determine aset of locations for a particular Node. The set of locations for theparticular Node may in turn by mathematically reconciled to determine abest location for the Node. For example, outlier sets of values may beset aside, included sets of values, and/or the set of locations for theparticular Node may be used to generate an average, a median, a weightedaverage, or other combined value.

At step 1613, a location of some or all Nodes in a SVAN may be plottedin a graphical representation. The location for a Node may be thelocations determined as described herein. In some embodiments, theunique IDs for plotted Nodes may be included in the graphicalrepresentation. Alternatively, or in addition to, the unique IDs, anannotation associated with a particular Node may be included in thegraphical representation. A graphical representation may include one orboth of two-dimensional and three-dimensional models of space occupiedby the SVAN. In some embodiments, these spatial models may be augmentedwith a time variable (e.g., by displaying a change in an area covered bya SVAN over time).

At step 1614, in some embodiments, a position of an Agent-supportedSmart Device may be determined relative to one or more of the Nodes in aSVAN. The Agent-supported Smart Device may be a smart phone carried by aperson or a smart device attached to a UAV or UGV. In some embodiments,the smart device will be programmed to communicate with a Base Node whenthe determines that it is within communication range with the Base Nodeusing a predetermined communication modality. For example, a GPSposition calculated by smart phone may indicate that the smart phone iswithin Bluetooth 5.1 range of a particular Base Node. The smart phone,acting as a Node, may then initiate Bluetooth 5.1 communication with theparticular Base Node.

At step 1615, using Orienteering methods, the SVAN may guide an Agentsupporting a Smart Device to a particular transport apparatus. Acontroller may receive position information of the transport and theAgent's smart phone and modify the graphical user interface on theAgent's smart phone to provide directions to the transport. As theAgent's smart phone begins the process by communicating with a first setof Nodes (that are within communication range of the Agent's smartphone), and as the Agent traverses a Healthcare Facility (or areasproximate to the Healthcare Facility), the Agent's smart phone maytransition to communicating with additional Nodes as those additionalNodes come with range of the smart phone. A graphical user interfacewill be modified as the Agent traverses the Healthcare Facility.

At step 1616, in some embodiments, an angle of a viewing screen of theAgent's smart phone relative to a ground plane may be determined as theAgent communicates with the SVAN. The angle of a viewing screen may helpdetermine if an image captured via operation of a smart phoneonboard-CCD image generator or other Image Capture Device is suitablefor inclusion in a graphical user interface. For example, most smartdevice-onboard CCD Image Capture Devices have a field of view that isgenerally perpendicular to a viewing screen of a smart phone.Consequently, an Agent may hold up the Agent's smart phone at an anglegenerally perpendicular to the ground plane and capture a view of anarea towards which the Agent is walking.

At step 1617, a graphical user interface may be overlaid on top of animage captured by the CCD Image Capture Device in a positionperpendicular to the ground plane. Positions of Nodes within the fieldof view of the CCD device may be indicated in combination with the imagedata captured by the CCD device, based upon the verified position of theCCD device, an angle at which the CCD device is being supported and adirection of interest determined via automated Orienteering apparatusand methods.

Embodiments may include the positions of the Nodes within the field ofview of an Image Capture Device associated with the smart phone beingindicated as the transport apparatus with which they are associated, andinformation related to those transport apparatus. Information mayinclude, for example, an indication of which transport apparatus isbeing associated with the smart device; which transport apparatus needservice; a transport apparatus type; which transport apparatus arerecently returned; etc.

At step 1618, the graphical user interface may also include annotationsor other details as they relate to the Nodes and/or the associatedtransport apparatus and/or aspects included in the field of view, suchas an exit, an office, or other detail.

At step 1619, in another aspect, some embodiments may include an overlayof image data captured in a field of view with information descriptiveof, or related to a Node with a position within the Field of View. Nodeinformation may include, for example, the unique ID associated with theNode, a Node model, battery charge remaining, signal strength, time oflast communication, details of data stored on the Node, amount ofstorage left in the Node, etc. In some embodiments, Nodes included in aGUI may be limited to those Nodes associated with transport apparatusand not display Nodes deployed as reference position Nodes or associatedwith other items.

At step 1620, in still another aspect, in some embodiments, a Node fixedto or within a transport apparatus may continue to communicate after itexits a Healthcare Facility. For example, if a Node is able tocommunicate with another Node, one or both of the Nodes external to theHealthcare Facility may note a GPS location and store the GPS locationin a manner associated with the Node to Node communication. If a Node isin a transport apparatus that is in motion, the Node may also noteaspects of the travel of the transport apparatus in which the Node islocated, such as, one or more of: speed, acceleration, transportapparatus diagnostics. Similarly, the Node may note a speed,acceleration and location of a Node with which it is communicating. Allor some communication data generated as a result of the Node-to-Nodecommunication may be transmitted via a modality other than a modalityused for the Node-to-Node communication. For example, if Node-to-Nodecommunication is accomplished via a Bluetooth modality or a sub-GHzmodality, the information resulting from the Node-to-Node communicationmay be retransmitted via a cellular or IP modality to an off-SVANdestination. Off-SVAN destinations may include, for example, a server, acontroller or a smart device, in logical communication with the Internetor a cellular connection.

Referring now to FIG. 17, method steps are illustrated for deploying aSVAN to manage activities, materials and people.

At step 1701, a unique Node ID is associated with one or more of:Healthcare Agent, equipment, medical supplies or resource to providepositional reference.

At step 1702, a first Node may be fixedly attached to, placed inside of,or otherwise co-located with one or more of: The Agent, resource,equipment, or a reference point.

At step 1703, reference point Nodes are located at strategic pointswithin or proximate to the Healthcare Facility. In some embodiments, thestrategic placements selected for reference point Nodes maybe based uponone or more of: a shape of the Healthcare Facility; a wireless modalitydistance capability; a presence of obstacles within an area occupied bya SVAN; at ends of hallways, and the like.

At step 1704, one or more Nodes included in a SVAN may be designated asa Base Node. Base Nodes may be operative to perform functions notnecessarily performed by Nodes that are not Base Nodes. For example,Base Nodes may aggregate data over time, perform controller functions,transmit data via more than one wireless Modality, be powered byutility-based alternating current, or communicate via a hardwired medium(e.g. ethernet cabling).

At step 1705, one or more of the Nodes may communicate with other Nodes.Preferably, each Node will communicate with each other node within rangeof a communication modality. In some embodiments, a pattern of Nodecommunication may be followed.

At step 1706, in some embodiments, a pattern of communication maystagger a time of wireless communication in order to avoid interferenceof one communication by another communication. A pattern ofcommunication may therefore include a “cascade” or hierarchical tree ofwireless communication transmission and receipt. For example, a BaseNode may communicate first, followed by a first generation of Nodes thatreceive a communication from the Base Node, follow up by communicationfrom the first generation of Nodes with a second generation of Nodes(e.g. Nodes that are out of range or obstructed from communicating withthe Base Node), then to third generation Nodes, etc.

At step 1707, one or more Nodes within the SVAN may be designated tocommunicate with a network access device extraneous to the SVAN. Forexample, a designated Node may aggregate data, such as an aggregation ofvalues for communication variables or sensor-generated data; andcommunicate the aggregated data to a destination outside of the SVAN(such as via a cellular transmission or an IP transmission).

At step 1708, in some embodiments, a SVAN may be defined based upon anability of SVAN participant Nodes to communicate with each other via aprimary communication modality. For example, a primary communicationmodality may include a Bluetooth modality, Wi-Fi, Wi-Fi RTT, sub GHzradio transmission and the like, and a secondary communication modalitymay include IP Protocol transmission, a cellular transmission, sub-GHzcommunication and the like.

At step 1709, some Nodes may be excluded based upon an inclusion orexclusion criteria. For example, in some embodiments, only Nodes withunique IDs associated with a particular type of equipment may beincluded in a SVAN, or only Nodes with unique IDs associated withmaterials prepped for deployment (e.g. immediate assembly into astructure) may be included in a SVAN. Alternatively, Nodes with IDsassociated with construction equipment recently returned or in need ofservice may be excluded from a SVAN.

At step 1710, communication variable values may be aggregated. Forexample, one or more Nodes or a controller may aggregate and store datathat is based upon, or quantifies, what transpires during a wirelesscommunication. Examples of data that quantifies, or is based upon, whattranspires during a wireless communication, may include, by way ofnon-limiting example, one or more of: a time of transmission, a time ofreceipt of a transmission, a phase angle of receipt of a transmission ofa single antenna, a respective phase angle of receipt of sametransmission by multiple antennas (which may include multiple antennasin one or more arrays of antennas). Other variables may include anamplitude of a received transmission, and a noise factor of a receivedtransmission.

At step 1711, a respective location of some or all of the Nodes in theSVAN may be generated, based upon the values for communication variablesthat are descriptive of communications with the respective nodes.Methods and variables involved in determining a location for a Node arediscussed extensively herein.

At step 1712, in some embodiments, an algorithm (such as those discussedherein) may be provided with values from the aggregated communicationvariable values to determine a location of a Node. Multiple sets ofvalues and/or multiple algorithms may be used to disparately determine aset of locations for a particular Node. The set of locations for theparticular Node may in turn be mathematically reconciled to determine abest location for the Node. For example, outlier sets of values may beset aside. Included sets of values and/or the set of locations for theparticular Node may be used to generate an average, weighted average, orother combined value.

At step 1713, a location of some or all Nodes in a SVAN may be plottedin a graphical representation. The location for a Node may be thelocations determined as described herein. In some embodiments, theunique IDs for plotted Nodes may be included in the graphicalrepresentation. Alternatively, or in addition to, the unique IDs, anannotation associated with a particular Node may be included in thegraphical representation. A graphical representation may include one orboth of two-dimensional and three-dimensional models of space occupiedby the SVAN.

At step 1714, in some embodiments, a position of an Agent-supportedSmart Device may be determined relative to one or more of the Nodes in aSVAN. The Agent-supported Smart Device may be a smart phone carried by aperson or a smart device attached to a UAV or UGV. In some embodiments,the Smart Device will be programmed to communicate with a Base Node whenthe Smart Device determines that it is within communication range withthe Base Node using a predetermined communication modality. For example,a GPS position calculated by a smart phone may indicate that the smartphone is within Bluetooth 5.1 range of a particular Base Node. The smartphone, acting as a Node, may then initiate Bluetooth 5.1 communicationwith the particular Base Node.

At step 1715, using Orienteering methods, the SVAN may guide an Agentsupporting a Smart Device to a particular piece of equipment, a set ofmaterials, a staging area, a drop off area, an office, or the like. Acontroller may receive position information of the equipment and thesmart phone and modify the graphical user interface on the smart phoneto provide directions to the equipment. An Agent's Smart Device maybegin the process by communicating with a first set of Nodes (that arewithin communication range of the smart device), and as the Agenttraverses a construction site (or areas proximate to the constructionsite), the Agent's smart device may transition to communicating withadditional Nodes as those additional Nodes come with range of the smartphone. A graphical user interface may be modified as the Agent traversesthe site to reflect in real time a relative location of the Agent andthe equipment.

In general, a user interface may be displayed upon a Smart Device, touchscreen or other human ascertainable mechanism. The interface may displaypositions of Nodes and/or associated Sensors, associated HealthcareFacility aspects, communications paths between Nodes, communicationsinterrupted by perceived obstructions, locations of items of interest,locations of Agents, locations of non-Agent persons and the like.

At step 1716, in some embodiments, an angle of a viewing screen of thecustomer's smart phone relative to a ground plane may be determined asthe customer communicates with the SVAN. The angle of a viewing screenmay help determine if an image captured via operation of a smart phoneonboard CCD image generator or other Image Capture Device is suitablefor inclusion in a graphical user interface. For example, most smartdevice-onboard CCD Image Capture Devices have a field of view that isgenerally perpendicular to a viewing screen of a smart phone.Consequently, an Agent may hold up the smart phone at an angle generallyperpendicular to the ground plane and capture a view of an area.

At step 1717, a graphical user interface may be overlaid on top of animage captured by the CCD image capture device in a positionperpendicular to the ground plane. Positions of Nodes within the fieldof view of the CCD device may be indicated in combination with the imagedata captured by the CCD device, based upon the verified position of theCCD device, an angle at which the CCD device is being supported and adirection of interest determined via automated Orienteering apparatusand methods.

At step 1718, the graphical user interface may also include annotationsor other details as they relate to the Nodes and/or the associatedequipment, material, structural aspects, agents and/or aspects includedin the Field of View, such as a site topographic drawing references orother detail.

At step 1719, in another aspect, some embodiments may include an overlayof image data captured in a field of view with information descriptiveof, or related to a Node with a position within the Field of View. Nodeinformation may include, for example the unique ID associated with theNode, a Node model, battery charge remaining, signal strength, time oflast communication, details of data stored on the Node, amount ofstorage left in the Node, etc. In some embodiments, Nodes included in aGUI may be limited to those Nodes associated with equipment, materials,agents, and the like. The GUI may not display Nodes deployed asreference position Nodes or associated with other items.

At step 1720, in some embodiments, Node information may be integratedinto Augmented Virtual Model (CAD), as well as any sensor co-locatedwith Nodes.

Referring now to FIG. 18, method steps are illustrated for deploying aSVAN to quantify conditions in a Healthcare Facility.

At step 1801, a unique ID number is associated with a Node ID.

At step 1802, respective Nodes are placed within, or proximate to,multiple respective defined resources or patient rooms.

At step 1803, a Sensor and/or Sensor assembly, such as a multi-sensormodule, is placed win logical communication with at least one Node thatis within or proximate to each disparate defined occupancy space. Insome embodiments, the strategic placement of Nodes maybe based upon oneor more of: a shape of the Healthcare Facility; a wireless modalitydistance capability; a presence of obstacles within an area occupied bya SVAN; at ends of constructed elements on a construction site, and thelike.

At step 1804, one or more Nodes included in a SVAN may be designated asa Base Node. Base Nodes may be operative to perform functions notnecessarily performed by Nodes that are not Base Nodes. For example,Base Nodes may aggregate data over time, perform Controller functions,transmit data via more than one wireless Modality, be powered byutility-based A/C current, and/or communicate via a hardwired medium(e.g. ethernet cabling).

At step 1805, one or more of the Nodes may communicate with other Nodes.Preferably, each Node will communicate with each other Node within rangeof a communication modality. In some embodiments, a pattern of Nodecommunication may be followed (e.g., through the cascading processdescribed above).

At step 1806, in some embodiments, a pattern of communication maystagger a time of wireless communication in order to avoid interferenceof one communication by another communication. A pattern ofcommunication may therefore include a “cascade” or hierarchical tree ofwireless communication transmission and receipt. For example, a BaseNode may communicate first, followed by a first generation of Nodes thatreceive a communication from the Base Node, followed by communication bythe first generation of Nodes with a second generation of Nodes (e.g.Nodes that are out of range or obstructed from communicating with theBase Node), then to third generation Nodes, etc.

At step 1807, one or more Nodes within the SVAN may be designated tocommunicate with a network access device extraneous to the SVAN. Forexample, a designated Node may aggregate data, such as an aggregation ofvalues for communication variables, Sensor-generated data; andcommunicate the aggregated data to a destination outside of the SVAN(such as, via a cellular transmission or an IP transmission).

At step 1808, in some embodiments, a SVAN may be defined based upon anability of SVAN participant Nodes to communicate with each other via aprimary communication modality. For example, a primary communicationmodality may include a Bluetooth modality (e.g. BT 5.1 or BLE), Wi-Fi,Wi-Fi RTT, sub-GHz radio transmission and the like, and a secondarycommunication modality may include IP transmission, a cellulartransmission, sub-GHz communication and the like.

At step 1809, some Nodes may be excluded, based upon an inclusion orexclusion criteria. For example, in some embodiments, only Nodes withunique IDs associated with a particular occupant, or only Nodes withunique IDs associated with resources or patient rooms that Sensorreadings indicate are vacant, may be included in a SVAN. Similarly,Nodes with IDs associated with a group of persons or an item ofequipment, as well as reference point position Nodes, may be included ininclusion or exclusion criteria.

At step 1810, communication variable values may be aggregated. Forexample, one or more Nodes or a controller may aggregate and store datathat is based upon, or quantifies, what transpires during a wirelesscommunication. Examples of data that quantifies, or is based upon, whattranspires during a wireless communication, may include, by way ofnon-limiting example, one or more of: a time of transmission, a time ofreceipt of a transmission, a phase angle of receipt of a transmission ofa single antenna, a respective phase angle of receipt of sametransmission by multiple antennas (which may include multiple antennasin one or more arrays of antennas). Other variables may include anamplitude of a received transmission, and a noise factor of a receivedtransmission. Data generated by Sensors associated with the respectiveNodes may also be aggregated.

At step 1811, a respective location of some, or all, of the Nodes in theSVAN may be generated, based upon the values for communication variablesthat are descriptive of communications with the respective nodes.Methods and variables involved in determining a location for a Node arediscussed extensively herein.

At step 1812, in some embodiments, an algorithm (such as those discussedherein) may be provided with values from the aggregated communicationvariable values to determine a location of a Node. Multiple sets ofvalues and/or multiple algorithms may be used to disparately determine aset of locations for a particular Node. The set of locations for theparticular Node may in turn by mathematically reconciled to determine abest location for the Node. For example, outlier sets of values may beset aside, included sets of values, and/or the set of locations for theparticular Node may be used to generate an average, a mean of othercombined value.

At step 1813, a location of some, or all, Nodes in a SVAN may be plottedin a graphical representation. The location for a Node may be thelocations determined as described herein. In some embodiments, theunique IDs for plotted Nodes may be included in the graphicalrepresentation. Alternatively, or in addition to, the unique IDs, anannotation associated with a particular Node may be included in thegraphical representation. A graphical representation may include one orboth of two-dimensional and three-dimensional models of space occupiedby the SVAN.

At step 1814, in some embodiments, a position of an Agent-supportedSmart Device may be determined relative to one or more of the Nodes in aSVAN. The Agent-supported Smart Device may be a smart device carried bya person, or a Smart Device attached to a UAV or UGV. In someembodiments, the Smart Device will be programmed to communicate with aBase Node when the Smart Device determines that it is withincommunication range with the Base Node using a predeterminedcommunication modality. For example, a GPS position calculated by asmart device may indicate that the smart device is within Bluetooth 5.1range of a particular Base Node. The smart device, acting as a Node maythen initiate Bluetooth 5.1 communication with the particular Base Node.

At step 1815, using Orienteering methods, the SVAN may guide an Agentsupporting a smart device to a particular piece of occupancy area, suchas an occupancy area that Sensor data indicates is vacant or an areathat the Sensor data indicates is occupied.

In some embodiments, a controller may receive position information ofthe resource or patient room and the Agent's smart device and modify thegraphical user interface on the Agent's smart device to providedirections to a selected occupancy area.

The Agent's smart device may begin by being guided via processing ofvalues for variables of communications with a first set of Nodes (whatare within communication range of the Agent's smart device), and as theAgent traverses a structure containing the resources or patient rooms(or areas proximate to the occupancy area), the Agent's smart device maytransition to communicating with additional Nodes as those additionalNodes come within range of the smart device. A graphical user interfacemay be modified as the Agent traverses the Healthcare Facilitycontaining the resources or patient rooms to reflect in real time arelative location of the Agent and an area of interest

At step 1816, in some embodiments, an angle of a viewing screen of theAgent's smart device relative to a ground plane may be determined as theAgent communicates with the SVAN. The angle of a viewing screen may helpdetermine if an image captured via operation of a smart device onboardCCD image generator (e.g. charged coupled device camera) is suitable forinclusion in a graphical user interface. For example, most smart deviceonboard CCD image capture devices have a field of view that is generallyperpendicular to a viewing screen of a smart device. Consequently, anAgent may hold up the Agent's smart device at an angle generallyperpendicular to the ground plane and capture a view of an area towardswhich the Agent is walking.

At step 1817, a graphical user interface may be overlaid on top of animage captured by the CCD Image Capture Device in a positionperpendicular to the ground plane, and positions of Nodes within thefield of view of the CCD device may be indicated in combination with theimage data captured by the CCD device, based upon the verified positionof the CCD device, an angle at which the CCD device is being supportedand a direction of interest determined via automated Orienteeringapparatus and methods.

At step 1818, the graphical user interface may also include annotationsor other details as they relate to the Nodes and/or the associatedresources or patient rooms and/or aspects included in the field of view,such as a site topographic drawing references or other detail.

At step 1819, in another aspect, some embodiments may include an overlayof image data captured in a field of view with information descriptiveof, or related to, a Node with a position within the field of view. Nodeinformation may include, for example, the unique ID associated with theNode, a Node model, battery charge remaining, signal strength, time oflast communication, details of data stored on the Node, amount ofstorage left in the Node, etc. In some embodiments, Nodes included in aGUI may be limited to those Nodes associated with a particular resourceor patient room. The GUI may or may not, upon discretion of a User orsystem manager, display Nodes deployed as reference position Nodes orassociated with other items.

At step 1820, in some embodiments, Node information and resources orpatient rooms may be integrated into an Augmented Virtual Model (AVM) aswell as data from any Sensor co-located with Nodes.

Referring now to FIG. 19A, an alternative case 1900 for a smart deviceis shown. This embodiment, one or more foldable support posts 1903 thatmay be extended to different positions 1903A-C may be foldablyextendable from case 1900. Support posts 1903 may include puck 1904 or asimilar antenna array arrangement. This may be advantageous because itmay increase the distance between a first puck 1904 and a second puck1905 and/or Nodes 1901, relative to the embodiments described above asthe. Increasing the distance between a first puck 1904 and a second puck1905 and/or Nodes 1901 may increase an accuracy of calculations basedtransceiving involving the Nodes 1901 and pucks 1904-1905.

Moreover, in such embodiments, a direction of the directional arraysattached to pucks 1904-1905 may be oriented perpendicularly to thedirection of the directional arrays in Nodes 1901. This may alsoadvantageously improve accuracy.

Additionally, alternative case 1900 may include an Image Capture Device1902 facing in a direction parallel to the orientation of the screen ofthe smart device. In this way, an agent can view the display of thesmart device from a top-down perspective, while still receivinginformation about an item in a direction of interest in front of theagent. In some embodiments, this parallel-facing Image Capture Device1902 may also be part of the smart device. As described above, in someembodiments, the Image Capture Device 1902 may have a fixed or varifocallens and may comprise prisms to allow Image Capture Device 1902 tocapture images at various angles relative to the angle of the lens. Inthis way, Image Capture Device 1902 may be operable to capture images ina direction consistent with the direction of the antenna arrays of Nodes1901 or puck 1904 or both.

This may also be useful in embodiments that use only one antenna array(e.g., one Node 1901 or puck 1904-1905). One antenna array may be usedin conjunction with the field-of-view angle of Image Capture Device 1902(or a separate Image Capture Device) to determine a direction ofinterest.

As illustrated, the foldable support post 1903 may be extended todifferent positions 1903A, 1903B and 1903C. The different positions1903A-C may be used to reposition the puck 1904.

FIG. 19B shows a foldable case 1930. In this embodiment, instead ofsupport posts 1903B that fold down from case 1900 to provide support tocase 1900 at an angle, foldable case 1930 includes a puck 1941 on asleeve 1940 that may fold parallel to foldable case 1930. The fold maybe implemented in a variety of methods, such as using a foldablematerial to create crease 1942 or placing a hinge between sleeve 1940and the body of foldable case 1930.

In this embodiment, the directional antennas of puck 1941 maintain thedirection of the directional antennas of Nodes 1931, but the increaseddistance between the two sets of directional antennas may produceadditional accuracy as well. In some embodiments, puck 1941 may beplaced on a side of sleeve 1940 that is in contact with the smart devicewhen sleeve 1940 is folded over foldable case 1930; in otherembodiments, puck 1941 may be placed on a side of sleeve 1940 that mayface perpendicular to a ground plane when sleeve 1940 is unfolded fromfoldable case 1930.

In some embodiments, foldable case 1930 may also include additionallenses for Image Capture Device 1902 (or other Image Capture Devicesassociated with the smart device). In this way, when foldable case 1930is aligned in certain ways over the lens of an Image Capture Device, theImage Capture Device may assume a different field of view, zoom level,or image angle than when unmodified by foldable case 1930.

Referring now to FIG. 20, additional method steps that may be performedas part of the present invention and related to a procedure performed inthe Healthcare facility. At step 2001, a transceiver, which may be inthe form of a Node or a Tag, is assigned to each of multiple Agents.Each transceiver may be associated with a unique identifier (which maybe a UUID).

At step 2002, a resource within the Healthcare Facility may be allocatedto the healthcare procedure. The resource may be allocated based upon atime for which the procedure is scheduled, and a length of time requiredfor completion of the procedure.

At step 2003, a location for one or more of the transceivers may beperiodically generated based upon multiple sets of wirelesscommunication variable values. Communication variables may include, forexample, those involved in wireless triangulation and/or determinationof an AoA and/or AoD and distance.

At step 2004, a location for one or more Agents may be periodicallytracked based upon a location of an associated transceiver.

At step 2005, a position of an Agent may be tracked relative to otherAgents. For example, a position of one Agent during a healthcareprocedure may be determined and recorded relative to another Agent.Accordingly, it may be determined that a procedure has a higher successrate when a particular nurse, or technician is located to the right of asurgeon during surgery if the surgery involves a left side of a patientor other positioning related statistical conclusions. The presentinvention enables the gathering of data to ascertain best practices toobtain a desired outcome.

At step 2006, in a similar manner, a position of an Agent relative toone or more items of equipment may also be tracked. In this manner, itmay be determined which Agent operated the equipment during a Healthcareprocedure and when. In some embodiments, control commands provided bythe Agent may also be quantified and recorded.

At step 2007, Agents may also be tracked relative to a resource. As anexample, a resource may be an operating room and the methods andapparatus described herein may quantify and record which Agents where inthe resource and when, such as prior to, during and post procedure.

At step 2008, metrics may be defined for ascertaining a degree ofsuccess of a procedure.

At step 2009, equipment parameters (and equipment location) may betracked. Parameters may include operational settings and controlcommands input into the equipment.

At step 2010, in some embodiments, timing of actions may be recorded, aswell as relative positions of Agents and equipment at the time of anaction.

At step 2011, conditions present in a resource or the HealthcareFacility may be quantified, such as via operation of a sensor. Thequantifications may be conducted prior to, during and after theprocedure.

At step 2012, any values of tracked items may be compared with, orotherwise associated with a healthcare procedure.

At step 2013, the tracked values associated with the healthcareprocedure may be referenced to provide an indication of a likelihood ofachievement of a desired outcome. Tracked values may include, by way ofnon-limiting example, a location of Agents and/or Equipment, a conditionquantified with a Sensor, a time of day, a day of week, a time of year,which Agents are present, which Healthcare Facility is involved, whichsteps are followed in conducting a procedure, etc.

At step 2014, in some embodiments, an instruction may be transmittedthat relates to a healthcare procedure, the instruction may be basedupon a position of an Agent and/or conditions quantified. For example,during a healthcare procedure, as the procedure is nearing a time ofcompletion, a wireless communication may be transmitted to multipletransport technicians. In some embodiments, one or more of the transporttechnicians may be designated based upon availability of the transporttechnician and a location of the transport technician relative to apatient on which the healthcare procedure has been performed.

Other factors, such as a type of transport required and special needs orattributes of the patient may also be included in a decision of whichtransport technician to transmit a request to transport to, and/or atransmit a selection to transport to. In addition, in some embodiments,a transport technician may transmit back acceptance of a request totransport. In some embodiments, a transport technician may be requiredto perform a minimum number of transports within a timeframe in order tomaintain a satisfactory performance rating and/or be eligible for asalary bonus or perk. The present invention provides location data andproximity to patients sufficient to enable alternatives to an hourlywage for exemplary transport technicians and other Agents.

At step 2015, biometrics may be performed on Agents, patients or otherpersons prior to, during and after a procedure. The biometrics mayquantify almost any bodily function that is measurable via electronicSensor.

At step 2016, an instruction may be transmitted based upon a biometric.Instructions may include, for example, proceed quickly, cease theprocedure, remove an Agent from the resource room; perform a routine, orother action.

At step 2017, any or all location, Sensor, and Biometric data may becoordinated and included in a user interface generated by a controller.The user interface may be displayed upon a smart device worn by anAgent, a display mounted on a Resource wall or ceiling; on a SmartDevice or on an equipment item.

Referring now to FIGS. 21 and 22, in some embodiments, an Agent mayassociate a virtual tag with an item of interest or a location ofinterest. Similar to physical tags described herein that engage inwireless communication useful to determine a location based upon thewireless communication. A virtual tag has a smart device in wirelesscommunication useful to determine of the smart device and thenassociates the determined location with the item of interest, orassociated an offset of the determined location with the item ofinterest.

For example, an Agent may place a smart Device proximate to an item ofinterest and execute executable code to causes wireless communicationwith one or both of a Node(s) and a Reference Point Transceiver(s). Alocation of the Smart Device based upon the wireless communicationbetween the Smart Device and the Node(s) and a Reference PointTransceiver(s). A location of a Virtual Tag may be congruent with thegenerated location of the Smart Device, or the Virtual Tag may be alocation offset from the generated location of the Smart Device.

An offset of a location of the Smart Device may be determined, forexample via a wireless determination of a position and orientation ofthe Smart Device and a further determination of a distance of the SmartDevice in a direction based upon the orientation of the Smart Device toan item of interest. A distance to an item of interest may be estimatedby the Agent, or determined via a sensor in logical communication with(or incorporated into) the Smart Device. Suitable sensors may include,by way of non-limiting example, a photoelectric sensor, such as theSharp™ infrared proximity sensor (GPY0A21YK).

In addition, a virtual tag may correlate an item of interest and/or alocation of interest (such as, for example, in an AVM) with informationabout the item of interest or location of interest. Similar to physicallocation Tags, information associated with a Virtual Tag may includelocation information, such as Cartesian or polar coordinate data withrespect to a reference point. An Agent may also input or updateinformation about the item of interest, such as for example viaalphanumeric text, or an image captured with a CCD included in the SmartDevice. For an item of interest with a virtual tag, the Agent may createthe virtual tag in the AVM and input (automatically through the smartdevice) location information, image data, sensor data, and/or annotativeentries. In this way, the virtual tag system may allow an agent toad-hoc create designated items of interest with virtual tags.

The virtual tag may be applied to an item of interest in multiple ways.For example, an orienteering application on the smart device may providean option to allow an Agent to designate a new item of interest. Uponselecting this option, a new data structure may be instantiated withinthe AVM or locally on the Agent's smart device that includes a locationfield. The location field may be populated by an item location. The itemlocation may be determined in several ways.

In a first non-limiting example, the item location may be a locationassociated with the smart device. This location may be determined basedon a GPS measurement or by the orienteering methods described hereinthat allow for more fine-grain location-finding. The location may alsobe determined by Bluetooth, NFC, or other communications protocolsassociated with the item of interest.

In some embodiments, the location associated with the virtual tag may beassociated with a displacement from the smart device applying thevirtual tag. This may occur in several ways. For example, an imagecapture device associated with the smart device may be pointed at theitem of interest, such that upon choosing to apply the virtual tag, animage of the item may be captured. In exemplary embodiments, this imagewill have a smart-device location associated with the image (in themetadata of the image, for example) based on the location of the smartdevice when the image was captured. This smart-device location may bethe same location described above (i.e., it may be determined based on aGPS or orienteering-based location of the smart device). By indicating adirection of interest (as described elsewhere herein) from the smartdevice in the direction of the item of interest, a displacement betweenthe smart device and the item of interest may be computed. Thisdisplacement may be a default magnitude (e.g., the location of thevirtual tag will be considered to be 10 cm away from the smart deviceand in the direction of interest). Alternatively, using well-known meanslike edge detection, lasers, sound generation analogous to echolocation,etc., the smart device may be able to choose in the image which objectis the item of interest and estimate a distance between the smart deviceand the item of interest. Other methods of determining the distancebetween the smart device and the item of interest may be employed aswell. Again, by combining at least (a) the location of the smart device;(b) the measured or approximated distance between the smart device andthe item of interest; and (c) the measured direction of interest, thelocation data input into the virtual tag may correlate in a moreadvantageous way with the location of the item of interest.

Moreover, because a virtual tag may be applied “virtually” (i.e.,through an interface on a smart device), an Agent may obtain evengreater accuracy by designating on a graphical interface specificallywhich object is meant to be tagged. This may be advantageous indesignating specific parts of an item of interest. For example,elsewhere in this disclosure and in related disclosures, Service Callsare discussed. In some embodiments, when an appliance is in need ofmaintenance, a system may request a service technician, who can beguided by the orienteering system to the appliance to effect necessaryrepairs. These repairs may not necessarily be completed in one ServiceCall. In addition to updating the entry in the AVM related to theappliance, the service technician may be able to apply a virtual tag toa specific portion of the appliance that needs additional attention,parts, or maintenance. This may be useful to remind the servicetechnician (or a different technician) on subsequent visits of sub-itemsof interest related to the appliance.

Once a virtual tag is applied to an item of interest, a virtual iconassociated with the virtual tag may appear on the Agent's smart deviceto indicate the location of the virtually tagged item. At that point,the Agent may include additional information relating to the item ofinterest, in a similar fashion to that described elsewhere. For example,after applying a virtual tag, the tag may be modifiable to include alast date of repair of the item of interest.

Although the above discussion relates to an “item” of interest, this isnot meant to be limiting. For example, if an AVM or orienteering systemas contemplated herein is deployed in a hospital, then an Agent mayapply a virtual tag to a patient, a resource, an equipment item and/or alocation. In addition to identifying a last-known location of thepatient, the Agent may include additional information relating to thepatient, such as medical or diagnostic information.

In some embodiments, the virtual tag may be applied locally to theAgent's smart device (i.e., only the Agent applying the virtual tag cansee the virtual tag after applying it). In other embodiments, thevirtual tag may be visible to any other Agents of the AVM through theirrespective smart devices. In such embodiments, the other Agents may beable to edit information associated with the virtually tagged item. Theoriginal Agent may be able to set a time after which the virtual tag“expires” and self-deletes, to ensure the AVM system does not becomecluttered with virtual tags. In some embodiments, subsequent Agents maybe able to edit the location of the virtual tag. For example, asubsequent Agent may be able to “drag and drop” an icon associated withthe virtual tag on the graphical user interface. Moreover, the AVM maybe operable to allow an administrator to modify or delete virtual tagsfrom a centralized location, instead of needing to visit the physicallocation of the virtual tag.

In addition to assisting subsequent Agents, virtual tags may be usefulto identify items of interest to simultaneous users of the AVM. Forexample, a method of using orienteering may include enhancing transportof patients throughout a healthcare facility. In one example ofsimultaneous use of virtual tags by multiple Agents, a team of Transporttechnicians may use virtual tags to quickly designate patients or itemsof interest for other members of a team of Healthcare providers toaddress. For example, a HCP using a heads-up display integrated into theHCP's headgear may place a virtual tag on a location of a patient or anitem of equipment. Other HCPs may see this virtual tag appear on theirdisplays thereafter.

In the above example, rapid data transfer may be necessary to achievethe purpose of virtual tagging. In situations where reallocation ofavailable resources is important, or emergency situations, data transfermay be slower due to equipment limitations. Accordingly, in someembodiments, the application associated with the AVM may have multiplemethods of virtual tagging. A “quick” virtual tag may be desirable inemergency situations. The quick virtual tag may not include some of thefine-grain location information described above (e.g., attempting tomake quick, accurate measurements of a distance between a smart deviceand the item of interest). Moreover, in the situation described above,the emergency responder may not have access to virtual buttons tocarefully indicate that a virtual tag is desired. In such situations, avoice command or a physical button press may be operable to virtuallytag the general direction of interest faced by a smart device associatedwith the first responder. For example, continuing the example of theteam of HCPs with heads-up displays in their visors, atemperature-resistant camera may also be placed proximate to the visor.By pressing a button, a virtual tag may be applied at a shortdisplacement in the direction of interest faced by the camera. Such avirtual tag may require relatively little data transfer and thereforemay be achieved in a short amount of time, as may be necessary indangerous, emergency situations.

Referring now to FIG. 21, An exemplary application of a virtual tag isillustrated with Agent 2100 shown holding smart device 2102, which hasGUI 2101. Shown on GUI 2101 is a virtual representation 2139 of machine2109. Agent 2100 may press a button 2131 (which may be a virtual orphysical button, or other indication of an intent to apply a virtualtag) to apply virtual tag 2132 to virtual representation 2139 of machine2109. In some embodiments, Agent 2100 may indicate a direction ofinterest 2114 (using the methods described herein and in otherapplications in this family) to better assist in the positioning ofvirtual tag 2132, as described above. Virtual tag 2132 may comprise adata structure having an associated location, as determined with respectto wireless reference transceivers 2110-2113 and, optionally, directionof interest 2114.

An exemplary method of applying a virtual tag is shown in FIG. 22. Atstep 2201, a Smart Device is positioned proximate to an item of interestis located by an Agent. The item of interest may be an item ofequipment, a resource, a patient room, an operation room, a machinery,apparatus, person, architectural feature, or any other item for which itmay be desirous to have a location stored in a database and, optionally,additional information. At step 2202, the Agent indicates an item ofinterest, or a location of interest, to be virtually tagged using theSmart Device. Indication of an item an item or location of interest maybe accomplished may be accomplished via the additional steps of 2203indicating a direction of interest in relation to the smart device andat step 2204 determine a distance of the item of interest from the smartdevice, as discussed above. In some embodiments, a direction of interestmay be signified with an auxiliary apparatus—such as a ring, wand,watch, or pointer—in logical connection with a smart device; or via oneor more cameras capturing hand movement of an Agent.

At step 2205, the Agent generates a virtual tag. The Agent may alsoindicate the item of interest or the location of interest on the smartdevice. This may occur in a variety of ways. For example, if the smartdevice is a smart phone or other device having a graphical userinterface (especially one in logical connection with an image capturedevice, such that an image of the item of interest is displayed on thegraphical user interface), the Agent may “tap” the image of the item ofinterest as displayed on the smart device to indicate the approximatelocation of the item of interest. In some embodiments, the Agent neednot specifically tap on the interface to indicate the item of interest;instead, edge-detection or other means may be used to analyze the imageon the smart device to determine spatial coordinates correlated topossible items of interest. Lasers, accelerometers, or sound generatorsmay also be used to determine a distance from the smart device to theitem of interest.

In still other embodiments, an Agent may indicate a direction ofinterest using any of the means described within this application andothers in the same family of patent applications. For example, the Agentmay thrust the smart device toward the item of interest. The Agent mayuse a specialized smart device enclosure to indicate the direction ofinterest. Or the Agent may “point” toward the item of interest with anancillary smart device, such as a wand.

At step 2206, the Agent may cause a virtual tag to be applied to theitem of interest or location of interest. Application of the virtual tagmay instantiate a data structure on the smart device (or, in someembodiments, in a controller or an AVM) that includes information aboutthe item of interest, including a location associated with the item ofinterest. The location may be the location of the Smart Device. Thelocation may also be related to the location determined by adding someoffset or displacement to the location of the smart device. Thedisplacement may be based on a number of factors and, be in theindicated direction of interest. The displacement may be a fixed value(e.g., 10 cm away from the smart device) or may use techniques thatapproximate how far away the item of interest is from the smart device(such as edge-detection, laser-measuring techniques, sound generationanalogous to echolocation, etc.). Such techniques may result in agreater location value entered into the virtual tag data structure.

At step 2207, the virtual tag (and information associated therewith) maybe uploaded to a controller and/or into an AVM. Uploading facilitatesmultiple Agents accessing the Virtual Tag and to view information aboutthe virtual tag. However, in some embodiments, it may be desirable toonly store the virtual tag locally on the Agent's smart device,depending upon the sensitivity of the information involved.

At step 2208, the Agent (or other users) may enter additionalinformation into the virtual tag that correlates with the item ofinterest. For example, the Agent may enter medical data about a patient,technical data about an item of equipment, etc. The Agent may link asmart device reading to the virtual tag using Bluetooth, NFC, ANT etc.,to allow for dynamic data updates.

Glossary

“Agent” as used herein refers to a person or automation capable ofsupporting a Smart Device at a geospatial location relative to a GroundPlane.

“Ambient Data” as used herein refers to data and data streams capturedin an environment proximate to a Vantage Point and/or an equipment itemthat are not audio data or video data. Examples of Ambient Data include,but are not limited to, Sensor perception of: temperature, humidity,particulate, chemical presence, gas presence, light, electromagneticradiation, electrical power, Moisture and mineral presence.

“Analog Sensor” and “Digital Sensor” as used herein include a Sensoroperative to quantify a state in the physical world in an analog ordigital representation, respectively.

“As Built” as used herein refers to details of a physical HealthcareFacility associated with a specific location within the physicalHealthcare Facility or parcel and empirical data captured in relation tothe specific location.

“As Built Features” as used herein refers to a feature in a virtualmodel or AVM that is based at least in part upon empirical data capturedat or proximate to a correlating physical location of the feature.Examples of As Built Features include placement of structural componentssuch as a wall, doorway, window, plumbing, electrical utility, machineryand/or improvements to a parcel, such as a well, septic, electric orwater utility line, easement, berm, pond, wet land, retaining wall,driveway, right of way and the like.

“As Built Imagery” (Image Data) as used herein means image datagenerated based upon a physical aspect.

“Augmented Virtual Model” (sometimes referred to herein as “AVM”) asused herein means a digital representation of a real Property parcelincluding one or more three-dimensional representations of physicalHealthcare Facilities suitable for use and As Built data captured thatis descriptive of the real Property parcel. An AVM includes As BuiltFeatures of the Healthcare Facility and may include improvements andfeatures contained within a Healthcare Facility.

“Bluetooth” as used herein means the Wireless Personal Area Network(WPAN) standards managed and maintained by Bluetooth Special InterestGroup (SIG). Unless otherwise specifically limited to a subset of allBluetooth standards, the Bluetooth will encompass all Bluetoothstandards (including, without limitation, Bluetooth 4.0; 5.0; 5.1 andBLE versions).

“Deployment” as used herein means the placement into operation of one ormore of: a Healthcare Facility resource and an equipment item.

“Deployment Performance” as used herein means one or both of: objectiveand subjective quantification of how one or more of: HealthcareFacility, machinery and an equipment item operated, which may bedepicted in an AVM.

“Design Feature” as used herein, means a value for a variabledescriptive of a specific portion of a Property. A Design Feature mayinclude, for example, a size and shape of a structural element or otheraspect, such as a doorway, window, or beam; a material to be used; anelectrical service; a plumbing aspect; a data service; placement ofelectrical and data outlets; a distance, a length, a number of steps; anincline; or other discernable value for a variable associated with aHealthcare Facility or Property feature.

“Digital Sensor” as used herein includes a Sensor operative to quantifya state in the physical world in a digital representation.

“Directional Indicator” as used herein means a quantification of adirection generated via one or both of: analog and digital indications.

“Experiential Data” as used herein means data captured on or proximateto a subject Healthcare Facility, such data descriptive of a conditionrealized by the Healthcare Facility. Experiential Data is generated byone or more of: Digital and/or Analog Sensors, transducers, ImageCapture Devices, microphones, accelerometers, compasses and the like.

“Experiential Sensor Reading” as used herein means a value of a Sensoroutput generated within or proximate to a subject Healthcare Facility,such output descriptive of a condition realized by the HealthcareFacility. An Experiential Sensor Reading may be generated by one or moreof: digital and/or Analog Sensors, transducers, Image Capture Devices,microphones, accelerometers, compasses and the like.

“Ground Plane” as used herein refers to a locally horizontal (or nearlyhorizontal) plane from which a direction of interest may be projected.An example of a Ground Plane is a floor of a Healthcare Facility.

“Healthcare Facility” as used herein refers to a manmade assembly ofparts connected in an ordered way. Examples of a Healthcare Facility inthis disclosure include a building used to perform healthcare proceduresof a sub-assembly of such a building.

“Image Capture Device” or “Scanner” as used herein refers to apparatusfor capturing digital or analog image data. An Image Capture Device maybe one or both of: a two-dimensional camera or a three-dimensionalcamera. In some examples an Image Capture Device includes acharge-coupled device (“CCD”) camera. An Image Capture Device mayinclude a camera with a wide-angle lens capable of capturing a greaterfield of view than a normal lens, or it may include a narrow-angle lenscapable of capturing a smaller field of view than a normal lens. AnImage Capture Device may include a fixed lens, in which the ImageCapture Device's focal length is permanently set (as would be its fieldof view), or a varifocal lens to allow manual adjustment of the cameralens. Even in embodiments having a fixed lens, Image Capture Device mayinclude additional lenses capable of being removably attached to thebody of Image Capture Device to modify an angle of the view of view or azoom level. An Image Capture Device may include a camera capable ofcapturing images from rays other than a ray extending parallel from alens associated with the camera (e.g., images at a 90 degree verticalangle from the direction in which the lens appears to face), such as bymirrors or other prisms.

“Intelligent Automation” as used herein refers to a logical processingby a device, system, machine or equipment item (such as data gathering,analysis, artificial intelligence, and functional operation) andcommunication capabilities.

“Moisture” as used herein means a quantity of water, which may also meana quantity of water relative to a larger volume (e.g., amount of waterrelative to air).

“Multi-modal” as used herein refers to the ability of a device tocommunicate using multiple protocols and/or bandwidths. Examples ofmultimodal may include being capable of communication using two to moreof: Bluetooth; Bluetooth Low Energy; WiFi; WiFi RT; GPS; ultrasonic;infrared protocols and/or mediums.

“Node” as used herein means a device including at least a processor, adigital storage and a wireless transceiver.

“Orientation of a Smart Device” as used herein refers to a designationof a direction that the Smart Device is pointing. The direction maygenerally be aligned with a user interface screen (e.g. a top of thescreen is aligned with a top edge of the Smart Device). However, variousembodiments may designate a direction based upon a physical edge of theSmart Device (e.g. an edge opposite to an

“Performance” as used herein may include a metric of an action orquantity. Examples of Performance may include metrics of: number ofprocesses completed, energy efficiency; length of service; cost ofoperation; quantity of goods processed or manufacture; quality of goodsprocessed or manufacture; yield; and human resources required.

“Performance Level” as used herein means one or both of a quantity ofactions executed and a quality of actions.

“Property” as used herein shall mean one or more real estate parcelssuitable for a deployed Healthcare Facility that may be modeled in anAVM.

“Tag” as used herein refers to one or more transceivers fixable to anitem.

“Ray” as used herein refers to a straight line including a startingpoint and extending indefinitely in a direction.

“Sensor” as used herein refers to one or more of a solid state,electro-mechanical, and mechanical device capable of transducing aphysical condition or Property into an analogue or digitalrepresentation and/or metric.

“Smart Device” as used herein includes an electronic device including,or in logical communication with, a processor and digital storage andcapable of executing logical commands.

“Structural Message” as used herein refers to a logical communicationgenerated by automation (such as a Sensor or machine) incorporated into,affixed to or operated within or proximate to a Healthcare Facility.

“Structural Messaging” as used herein refers to an action that generatesand/or transmits a Structural Message.

“Total Resources” as used herein shall mean an aggregate of one or moretypes of resources expended over a time period.

“Transceive” as used herein refers to an act of transmitting andreceiving data.

“Transceiver” as used herein refers to an electronic device capable ofone or both of transmitting and receiving data.

“Vantage Point” as used herein refers to a specified location which maybe an actual location within a physical Healthcare Facility or a virtualrepresentation of the actual location within a physical HealthcareFacility.

“Vector” as used herein refers to a magnitude and a direction as may berepresented and/or modeled by a directed line segment with a length thatrepresents the magnitude and an orientation in space that represents thedirection.

“Virtual Healthcare Facility” (“VS”): as used herein shall mean adigital representation of a physical Healthcare Facility suitable foruse. The VS may include Design Features and As Built Features. The VSmay be included as part of an AVM.

CONCLUSION

Particular embodiments of the subject matter have been described. Otherembodiments are within the scope of the following claims. In some cases,the actions recited in the claims can be performed in a different orderand still achieve desirable results. In addition, the processes depictedin the accompanying figures do not necessarily require the particularorder show, or sequential order, to achieve desirable results. Incertain implementations, multitasking and parallel processing may beadvantageous. Nevertheless, it will be understood that variousmodifications may be made without departing from the spirit and scope ofthe claimed invention.

The headings used herein are for organizational purposes only and arenot meant to be used to limit the scope of the description or theclaims. As used throughout this application, the word “may” is used in apermissive sense (i.e., meaning having the potential to), rather thanthe mandatory sense (i.e., meaning must). Similarly, the words“include”, “including”, and “includes” mean including but not limitedto. To facilitate understanding, like reference numerals have been used,where possible, to designate like elements common to the figures.

The phrases “at least one”, “one or more”, and “and/or” are open-endedexpressions that are both conjunctive and disjunctive in operation. Forexample, each of the expressions “at least one of A, B and C”, “at leastone of A, B, or C”, “one or more of A, B, and C”, “one or more of A, B,or C” and “A, B, and/or C” means A alone, B alone, C alone, A and Btogether, A and C together, B and C together, or A, B and C together.

The term “a” or “an” entity refers to one or more of that entity. Assuch, the terms “a” (or “an”), “one or more” and “at least one” can beused interchangeably herein. It is also to be noted the terms“comprising”, “including”, and “having” can be used interchangeably.

Certain features that are described in this specification in the contextof separate embodiments can also be implemented in combination in asingle embodiment. Conversely, various features that are described inthe context of a single embodiment can also be implemented incombination in multiple embodiments separately or in any suitablesub-combination. Moreover, although features may be described above asacting in certain combinations and even initially claimed as such, oneor more features from a claimed combination can in some cases be excisedfrom the combination, and the claimed combination may be directed to asub-combination or variation of a sub-combination.

What is claimed is: 1.-20. (canceled)
 21. A method of quantifyinghealthcare agent interaction during a healthcare procedure, the methodcomprising: a) assigning a respective unique identifier with each of atleast, a first transceiver, a second transceiver, and a thirdtransceiver included in an array of transceivers; b) removably attachingthe first transceiver to a first healthcare agent, and the secondtransceiver to a second healthcare agent during a time of the healthcareprocedure; c) attaching the third transceiver to a reference position ina healthcare facility resource during a time of the healthcareprocedure; d) wirelessly communicating between the first transceiver thesecond transceiver and the third transceiver during performance of thehealthcare procedure; e) generating values for communication variablesbased upon wirelessly communicating between the first transceiver; thesecond transceiver and the third transceiver, the communicationvariables comprising: a start time of a respective wirelesscommunication transmission (T₁); a receipt time of the respectivewireless communication (T2); an angle of arrival of the respectivewireless communication transmission at a respective first antenna; andan angle of arrival of the wireless communication transmission at arespective second antenna; f) storing, in a digital storage thegenerated values for communication variables and unique identifiers forthe first transceiver; second transceiver and third transceiver; g)storing, in the digital storage, values for communication variables andthe unique identifiers for the first transceiver; second transceiver andthird transceiver to a controller; h) with the controller, generating arespective set of position coordinates indicative of a position of eachof the first healthcare agent; and the second healthcare agent, eachrespective set of position coordinates based upon values included in anaggregate of values for communication variables received into thecontroller; and i) with the controller, generating an orientation of oneor both of the first healthcare agent and the second healthcare agent.22. The method of claim 21 additionally comprising the step ofdesignating position coordinates of the healthcare facility resource abase position for the third transceiver.
 23. The method of claim 22additionally comprising designating the base position as one of:co-located with a position of the first transceiver, and offset from thefirst transceiver, according to a set of offset coordinates.
 24. Themethod of claim 22 additionally comprising the steps of: generating aprocedure step included in the healthcare procedure; correlating aprocedure time for the procedure step with T1 and T2; generating aposition of each of the first transceiver, the second transceiver andthe third transceiver during the procedure time based upon therespective T1 and T2 for each of the first transceiver, the secondtransceiver and the third transceiver; and generating a position of eachof at least one of the first healthcare agent, and the second healthcareagent during the healthcare procedure.
 25. The method of claim 22additionally comprising the step of summoning a third healthcare agentvia wireless communication with a smart device supported by the thirdhealthcare agent and providing orienteering instructions to the thirdhealthcare agent via wireless communication with a fourth transceiveralso supported by the third healthcare agent, the orienteeringinstructions comprising an indication of a position and orientation ofthe fourth transceiver.
 26. The method of claim 22 additionallycomprising the step of designating a position and orientation of thefirst healthcare agent relative to a position of the second healthcareagent during a time of the healthcare procedure.
 27. The method of claim26 additionally comprising the step of designating a position of atleast one of the first healthcare agent, and the second healthcareagent, in relation to an item of equipment.
 28. The method of claim 26additionally comprising the steps of: quantifying a biometric conditionof at least one of the first healthcare agent and the second healthcareagent with a sensor located in the healthcare facility resource.
 29. Themethod of claim 28, wherein the biometric condition comprises a bodytemperature and the method additionally comprises the step of denyingaccess to the healthcare facility resource if the body temperatureexceeds a designated range.
 30. The method step of claim 26 additionallycomprising the step of; with a sensor, quantifying a condition presentin the healthcare facility resource.
 31. The method of claim 30, whereinthe condition quantified comprises a biometric of one of the firsthealthcare agent, and the second healthcare agent.
 32. The method ofclaim 29 wherein at least one of the respective sets of coordinatescomprises Cartesian coordinates.
 33. The method of claim 29 wherein atleast one of the respective sets of coordinates comprises polarcoordinates.
 34. The method of claim 29 wherein at least one of therespective sets of coordinates comprises cylindrical coordinates. 35.The method of claim 29, additionally comprising the step of generating,with the controller, a time differential between T1 and T2.
 36. Themethod of claim 35, additionally comprising the step of, with thecontroller, generating a user interface comprising a location andorientation of at least one of: of the first transceiver, and the secondtransceiver during the time of the healthcare procedure.
 37. The methodof claim 35, additionally comprising the steps of, with the controller,determining that one of the first agent and the second agent isoperating an item of equipment during the healthcare procedure basedupon a location and orientation of the first healthcare agent and thesecond healthcare agent; and generating a user interface comprising alocation of at least one of the first healthcare agent, the secondhealthcare agent and the item of equipment.
 38. The method of claim 37,additionally comprising the step of, with the controller, generating auser interface comprising a location and orientation of the equipmentitem.
 39. The method of claim 37 additionally comprising generating anoverlay of image data generated by a charged couple device, the overlaycomprising a graphical representation of a location of at least one of:the first healthcare agent, and the second healthcare agent.
 40. Themethod of claim 37 additionally comprising generating an overlay ofimage data generated by a charged couple device, the overlay comprisinga graphical representation of a location of the equipment item.